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FOREWORD 

As noted in the introduction (Section I), the purpose of the report is to 
lay a foundation for the design of low-cost training systems through an 
analysis of skill performance. The foundation is based on implications for 
training of the processing of information as viewed in modern learning, theory. 
Much of the study is tutorial; however, the analyses are invaluable for 
building a data base of behavior<\l information from which principles for 
guidance in equipment design and use may be derived. The analyses contribute 
to th^.s goal by f^'oviding extensive and insightful information to show how and 
why ludern learning theory should replace the oudated learning theory that 
still guides skill training in most respects. ^ 

Because much of the treatment is theoretical, there is a need to relate 
it to basic applied concepts. Section II, Basic Behavioral Concepts^ , provides 
empirical conceptual tools for this purpose. The emphasir"is descriptive 
rather than theoretical, and the concepts identified are inferences from 
observable aspects of behavior. For instance, in the subsection " Primitive " 
Concepts , the need to analyze the roles of feedback is discussed. Questions 
concerning the ^yalue of platform motion in flight simulators are used to 
illustrate the complexities of feedback in training. In the subsection 
Higher-Order Concepts , such matters as cue development, transfer of training, 
and interference are covered. These factors are represented as being 
fundamental to the development of transferable skills and are emphasized as 
the critical factors in the successful use of training devices. (This 
material sets the stage for further : discussions of transfer of training in 
Section V.) Two additional concepts discussed at the end of Section II, skill 
robustness and hierarchical orgar"-^^^ n, provide bases for firther 
understanding of skill mastery, task integration, and instructional conditions 
required for optimal transfer of learning. 

Sections III and IV consider the dimensions of cognitive and motor skills 
that are amenable to training. The material becomes more theoretical in these 
sections but is interspersed with many practical rules which arise from 
theory. In Section III, Analysis of Cognitive Skills , the author stresses the 
need for cognitive task analysis so that training can be based on more than 
grossly generalized training principles which provide little guidance for 
particular training practices. Section IV, Analysis of Motor Skills , 
emphasizes aspects of motor performance such as the temporal cKaf acteristics 
of movements that must be accounted for if transfer is to be successful 
Implications for low fidelity devices are illustrated. For example, 
functional cha ^tics of training devices should not foster rhythmic 

patterns of motor actions thr»t are different from those necessary in^ 
operational equipment. • ^ the subsection on organization of motor skills, 
three examples are presented which illustrate the feasibility of a systematic 
methodology for observing and quantifying skill integration. 

Section V, Manifestation of Transfer in Training , presents empirical 
indicators of the nature and amount of transfer of device training to 
operational equipment and situations. It also illustrates now the indirators 
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can reflect processes and effects of training in terms of the analyses in 
Sections III and IV. Four empirical indicators are described'as parameters of 
performance curves that can be readily quantified. These parameters are 
beginning l evbl , asymptotic level , rate of learni ng, and an inflection point 
whicirTs a derivative of learning rate. ■IncludeiT'is a discussion of the 
significance of each parameter for studies of transfer in applied settings. 
Measures of the four parameters require the fitting of curves to learning and 
transfer data. Examples are taken from actual field studies. They illustrate 
how we may miss the significance of data because data points alone may produce 
a- misleading picture. As pointed out by Dr. Spears, the pattern of data 
shown by curve fitting may well say more than the data points per se can 
reveal . 

The last section (VI) concludes that a training technology based on human 
performance can be derived for existing knowledge. Three research topics are 
discussed that illustrate individual research questions and programmatic 
efforts related to the role of the earlier analyses in applied training. 

As stated, the primary purpose of the report was to provide a foundation 
for the design of low-cost training devices. However, the extensive analyses 
of skill performance necessary for achieving this goal also provides a 
foundation for training design in general. Although largely theoretical in 
development, the focus is nevertheless on aspects of modern learning theory 
that can be utilized di rectly "when planning training, and without having to 
follow a theoretical system as such,. 

' ^ The report can best be used in its present form by personnel who are , 
familiar with the process of translating behavioral information into training 
design specifications. This translation process would be facilitated through 
development of a method for performing learning analyses as described in the 
report. Development of this' method would be -high priority for further 
research efforts. ^ second research priority is to develop an efficient 
method for using ' learning analyses to specify the desiap f instruction'^ 
feature ■ sY ''2 \r luded in a particular training om. 

ARTHUR BLAIWES 
Scientific^ Officer 
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PREFACE 



This report documents a study of training considerations underlying the 
design and effective use of part-task and low-fidelity training devices. The 
study was conducted under Naval Training Equipment Center Contract No, 
N61339-78-C-0113, Mr, William B, Boney served as the initial technical 
monitor for the contract. Dr. Arthur S, Blaiwes was the initiator and 
technical monitor of the study described in this report* Dr. Paul W..; Caro 
was the Project Director for Seville. 

The author is grateful for the support provided by Dr. Caro during the 
preparation of the report and for his insightful suggestions regarding its 
presentation. Thanks are'also due for helpful comments by Mr, Joseph A. 
Puig of NAVTRAEQUIPCEN, Dr. Donald P. Foshee of Valdosta State College and 
Dr. James 6. Greeno of the University of Pittsburg. Dr. Foshee and Mr. 
Puig reviewed all sections of the report, and Dr. Greeno' s special 
contribution was for the section on analysis of cognitive skills. The 
expression of gratitude is not to suggest, however, that the reviewers endorse 
all statements in the report. 



3/4 



8 



NAVTRAEQUIPCEN 78-C-0113-4 
TABLE CF CONTENTS 



Section Page 

I INTRODUCTION AND APPROACH 9 

BACKGROUND 10 

STATEMENT OF PURPOSE 11 

APPROACH . , 11 

Orientation 12 

Method - . . 13 

II BASIC BEHAVIORAL CONCEPTS 15 

"PRIMITIVE" CONCEPTS , • • • • 16 

Discrimination 16 

Generalization . 

Feedback » . 18 

Set . . ............ 20 

HIGHER-ORDER CONCEPTS 20 

f 

Cue Development 20 

Learni ng Set 22 

Transfer 25 

Interference 29 

ADDITIONAL CONCEPTS , . . 30 

Skill Robustness. 30 

Hierarchical Organization 31 

III ANALYSIS OF COGNITIVE SKILLS 33 

EMERGENCE OF MODERN COGNITIVE PSYCHOLOGY 34 

OVERVIEW OF INFORMATION PROCESSING. . 36 

MODELS OF MEMORY ^ 37 

Conceptions of Memory 38 

Dual-Process Theory ..... 41 

SKILL LEARNING, PROBLEM SOLVING, AND 

EXECUTIVE PROCESSES 45 

5 Q 



NAVTRAEQUIPCEM 78-C-0113-4, 
TABLE OF CONTENTS (continued) 



Section Page 

Recognition of a Problem 46 

Comprehension of the Task . . . 47 

Planning Performance 49 

Initiating, Monitoring, and 

'Regulating Performance 49 

Evaluating Performance. . . 52 

SHORT-TERM PROCESSES > . 54 

Encoding 55 

Retention/Retrieval of Information 

and Transfer to LTM 62 

LONG-TERM PROCESSES • • • • ^ 

MOTIVATION . .• 67 

IV ANALYSIS OF MOTOR SKILLS ' 70 

MODELS OF MOTOR SKILLS , 70 

Channel Model s 70 

Process Models 72 

MOTOR ASPECTS 74 

Response Production 74 

Structural Characteristics of Movements 75 

Temporal Characteristics of Movements 79 

PERCEPTUAL ASPECTS 83 

Discrimination of Signals 84 

Generalization of Signal Discriminations ....... 85 

Roles of Sensory Modes 86 

COGNITIVE ASPECTS 89 

Establishment of Strategies . 89 

Execution of Actions ^ 93 

ORGANIZATION OF MOTOR SKILLS 95 

Integration of Skills 95 

Hierarchical Characteristics of Moto • Skills, 101 

Effects of Interference 102 

Effects of. Fatigue 103 

10 



NAVTRAEQUIPCEN 78-C-0113-4 ' 



TABLE OF CONTENTS (continued) 



Section 



Page 

V MANIFESTATIONS OF TRANSFER IN-,TRAINING 105 

GENERAL COMMENTS REGARDING CURVE FITTING ' 106 

BEGINNING LEVEL iqq 



Units for B. . . . , . . . . . no 

Task 2 Beginning Level and 

Transfer. of Training m 

ASYMPTOTIC LEVEL 

Asymptotic Level and Transfer of Training ne 

,, .RATE OF LEARNING 117 

Rate of Learning and Transfer of Training 125 

INFLECTION POINT i26 

Inflection Point and Transfer of Training 129 

VI VALUE OF ANALYSES FOR TRAINING AND TRAINING RESEARCH . 130 

ASSESSMENT OF SKILL ANALYSES FOR TRAINING 130 

ILLUSTRATIVE RESEARCH PROJECTS 131 

Procedures for Learning Analyses 132 

Nature and Progress of Skill Integration 135 

Interpretable Manifestations of Transfer 136 

Integration of Research I37 

REFERENCES 138 

'a 



er|c V 



11 



( 



NAVTRAEQUI^CEN 78-C-0113-4 



TABLE OF CONTENTS (continued) 
LIST OF ILLUSTRATIONS 



Figure 

1 Performance on the overhead pattern in the ASPT. ... 97 

2 Same as Figure^l except tricit curves represent 

f^its to logistic equations 98 

3 Mean numbers of flight segments recognized on 

successive aircraft rides 100 

4 Mean percent error for three training groups 

on successive aircraft trials. ... 109 

5 ' Mean number of landmarks recognized on each 

of 14 aircraft rides > 113 

6 Mean ratings by landing signal officer for 

groups with and without prior NCLT training. . . . 120 

7 Curves fitted to data points in Figure 6 121 

Illustration of a*logist:c curve with inflection 

point in units of X_ and _V • • ^^7 

LIST OF TABLES 

Table ' \ Pi2£ 

1 . ' Aircraft first- trial errors and values 

derived through curve fitting. 110 

2 Percent error for seven maneuvers by day ' ^ 

of training and checkride grade 115* 

3 Asymptotic level A for cumulative errors by 

checkride gra'^e and number of days used 

to fit equatiorr. . . . . 115 

Rate constant k^ for cumulative errors t)y 
cJieckride grade and number of days used 
to fit equation. 123 

5 Projected percent errors; on day 28 by checkride 



grade and number of days used to fit equation. . . 124 • 

6 Constants for curves for numbers of 

landmarks recognized 128 

ERiC 8 12 



NAVTRAEQUIPCEN 78-C-0113-4 



SECTION I 
INTRODUCTION AND APPROACH 



The purpose of this report is to identify dimensions of skill performance 
in tenns of modern learning and behavior theory. In doing so, it completes 
the first step of efforts to develop rationales for the design and use of 
part-task and low-fidelity training devices. The report is long because there 
is so much known now about skill performance that needs to be brought to the 
fore, knowledge that somehow has not been incorporated into formal, treatments 
of skill learning in applied contexts. Thus it is necessary to delWate fac- 
tors affecting, and the processes involved in, behavior that are Considered 
only intuitively, if at all, by those who design training programs and related 
equipment. While the report does not do full justice to details of the pro- 
cesses involved, it seeks to identify those of critical importance which are 
also amenable to training. 

Skill training in military contexts has not progressed significantly 
beyond the insightful, but seriously inadequate, formulations of Edward Lee 
Thorndike in the first third of this century. Thorndike built on concepts of 
learning that, in philosophical treatments, date back to ancient Greece and 
intuitively, probably back to primitive man prior to associationists such as 
Aristotle. What Thorndike--among many others--d1d was to express these age- 
old insights in terms of empirical relations. This was no mean achievement. 
One might even compare It to Galileo's empirical reduction of Aristotle's 
erroneous belief that heavy objects fall faster than light objects to a simple 
matter of momentum. A heavy falling object hits harder than a light one does 
not because it falls faster, but because the impact is the effect of its 
velocity, whatever it might be, multiplied by its mass. 

Isaac Newton formulated Galileo's observations, and numerous others 
including his own, into three comprehensive laws. Thorndikei humbly and with 
'10 pretense of being psychology's Newton, proposed laws of learning. The law 
of frequency or practice stated simply that other things being equal, connec- 
tions between stimuli and responses will increase in strength according to the 
number of times stimuli and responses occur together. A second law, the law 
of effect, stated that the connections will be strengthened if they art- 
followed by a desirable result, or weakened if the outcofffe is undesirable. 
Later this law was qualified with respect to undesirable outcomes. It was 
als- expanded to the law of spread of effect in order to accommodate gradients 
of desirable and undesirable outcomes. 



As with Newton's laws of motion, Thorndike' s simple statements of the 
relations Involved seem vacuous upon assertion. Compare to Th -ndike's law of 
practice Newton's first law, "the motion of an object will remain constant in 
velocity unless acted upon by an outside force." The trouble was that 
Thorndike' s laws had nowhere near the deductive potential of Newton's, even 
though Thorndike' 5 are frequently applied as if they were comprehensive. In 
fact, the most important, and complicated, aspect of learning and 
performance-Tmeani ng--was eventually subsumed by Thorndike under the super- 
ficial principle of "belongi ngnes*;." Two things, like salt and pepper, are 
associated because they belong together. 

1 '> 
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Training as governed by Thorndiklan conceptions has Involved simply 
trainees' practicing a task with appropriate guidance, and observing the 
effects of their actions (feedback or knowledge of results). Intuitively we 
have attempted to account for belongingness by making practice "meaningful" 
because numerous experiments on learning and retention have shown that meaning 
enhances both. But what is meaning? How does it come about? What is its 
structure? Why and how does it enhance learning, retention, and performance? 
How can it be developed or provided? Are there many types and levels of 
meaning? Does it make a difference which types -and levels are provided or 
developed during training? What should be known about individual trainees in 
order to optimize meaning? 

The answers to these questions reveal the complexity of behavior that 
even laymen know must exist. But only during the last twenty years or so have 
answers been developed scientifically and systematically. These developments 
have not yet had an appreciable impact on military training. We still go at 
meaning like a layman--intu1 tively . The absence of modern thinking is espe- 
cially noticeable in the design of training equipment and ...structional 
programs for its use. The present study reviews the modern science of behav- 
ior and learning, and identifies factors and processes intuition cannot lead 
to, but upon which systematic training conceptions can be based. 

The remaining parts of this section of the report discuss the background 
for the study and present ix formal statement of purpose. Then a summary of 
the approach indicates the contents and organization of the remaining sections 
of the report. 

BACKGROUND 

Military training is an expensive endeavor. An area where the expense 
has grown especially rapidly in recent years is the training of operator 
skills. The complexity of modern military equipment increasingly demands of 
operators a comparable complexity in skill knowledge as well as a high degree 
of precision in skill performance. Military readiness requires that these 
demands be met. Budgetary constraints require that the training of operators 
be as cost effective as possi'jle. 

Cost effectiveness can often be improved through use of relatively Inex- 
pensive training equipment to substitute for operational equipment during at 
least some phases of training. Also, simplifying training settings relative 
to the conditions surrounding operational performance often leads to signi- 
ficant cost reductions. Simulators have proved valuable in both of these, 
respects. Those in ube are generally less costly to procure than actual 
equipment, and even less costly to operate during training. They pemit the 
simplification of training settings in that a classroom or teaching laboratory 
substitutes for an often unwieldly operational environment. There is also the 
advantage that simulators can be designed specifically for training. Actual 
equipment is necessarily designed for operational use. and hence usually lacks 
features and functional capabilities needed to capitalize on principles of 
training technology, rurthermore, skills can be taught safely with simulators 
that would involve danger to the student (or equipment) if actual equipment 
were used. 
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Even so, the complexity of much modern military equipment often requires 
considerable engineering and hardware costs even for devices to simulate the 
actual equipment. Therefore, a valid approach to reducing the costs of 
training devices and their use could lead to savings over and above those 
accruing from past substitutions of simulators for operational equipment. 

Two cost-saving approaches that have been tried in the past several years 
are (1) the use of part-task trainers instead of full simulation trainers for 
portions of training; and (2) the reduction of fidelity of training devices to 
the physical characteristics of actual equipment. Both approaches have shown 
considerable promise. However, judging from current literature on training, 
both approaches lack a definitive guiding rationale -ror their conception, 
design, and use. Part-task and low-fidelity training devices are typically 
designed on an ad hoc, sometimes speculative, basis. The insights and anal- 
yses that guide the designs are not formulated sufficiently to guide the con- 
ception of such devices on a general basis. Furthermore, lacking fonmulation, 
the insights and analyses cannot identify Issues of uncertainty (or of 
outright error) In device conception, design, and use that can be resolved 
only through research. Instead, a given device is evaluated in use, and 
accepted, modified, or rejected according to the outcome. While those respon- 
sible for the evaluations often report insightful analyses of what is effec- 
tive and ineffective in devices and their use, these analyses, too, are ad hoc 
in that they apply primarily to the particular devices studied. As a result, 
little progress has been made toward a general formulation of rationales for 
part-task and low-fidelity trainers. There is even less progress toward 
identifying research issues which, once resolved, could remove uncertainties 
regarding such equipment on a general basis. 

STATEMENT OF PURPOSE 

As stated, there is a need to develop rationales for the conception, 
design, and use of part-task and low-fidelity training devices. It is also 
important to identity gaps in our knowledge regarding skill training that, 
once removed through subsequent research, would ensure effective and efficient 
use of devices of these sorts. To accompl ish these goal s, it wil 1 be 
necessary to re f omul ate trai ni ng issues i n terms of modern conceptions of 
learning. Reformulation is dictated by the fact that the training of complex 
skills is aTmost universally conceived within a Thorndikian framework. There 
is 1 i ttl e emphasis on information processir the locus of al 1 skll 1 
perfonnance. 

The first step toward achieving these goals, which is documented in this 
report, identified the learning and other behavioral concepts needed to 
analyze training issues of concern, and developed analyses on which the 
reformulation can be based. Future efforts will be required to derive 
rationales for low-cost training devices and identify research issues that 
should be clarified. 

APPROACH 

The discussion that follows describes the approach employed during the 
first step for identifying learning and behavioral issues of concern, and for 
analyses of cognitive and motor skills. 

erIc " 
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ORIENTATION. The orientation of the approach follows the reasoning of Caro, 
Shelnutt, and Spears (1981) and Prophet, Shelnutt. and Spears (1981) with 
regard to the need for learning analyses to guide the design of training and 
training equipment. A contrast of learning analyses with task analyses, and: 
with the Interservice Procedures for Instrjctional Systems Development (U.S. 
Navy, 1975), commonly referred to as ISO, will clarify what is involved in 
learning analyses. Task analyses focus on objective characteristics of what 
is done and accomplished during skill performance: the objective events that 
"cue" the initiation of an action, a description of what is to be done (task 
elements) in terms of objectives to be accomplished, and criteria for success- 
ful completion of an action. Building on task analyses, ISO prescribes ways 
to relate the various tasks and conditions for performance to Instruction and 
Instructional equipment. 

In contrast, learning analyses begin with what is later described as cognitive 
task analyses. The intent is to identify the content and organization of 
skill knowledge, and to track the processing of information during skill per- 
formance. As will be clearly evident in Sections III and IV, the cognitive 
representations of skills and their performance introduce considerations for 
teaching discriminations and generalizations, and for avoiding or exploiting 
interference, that cannot even ^e anticipated in usual task and ISO analyses. 
Hence, building on cognitive taN< analyses, learning analyses relate training 
procedures to the locus of skill competence, the processing of information by 
the performer. 

The complexity of infonndtlon processing, of the mediational components and 
their roles, is precisely what is ignored in most formal analyses of the 
training of complex skills. It is not much of an exaggeration to say that 
skill performance is viewed only in terms of the objective descriptions 
obtained' through task analyse?. In describing what is to be done and when, 
task performance itself is supposedly described. What is done and when" 
identifies the goal of skill training, not the process of skill performance, 
and even less the process of :>kill acquisition, A computer can be programmed 
to provide a set of printouts following specific inputs. But the printouts 
and inputs are not the program--the process--whereby the desired results are 
obtained, Nf:ither do printouts and inputs explain how to program the com- 
puter, how to "train" it to pervonn as desired. Pushing the analogy one step 
further, "debugging" inadequate :>kill performance, like debugging a computer 
program, requires an understanding of the process whereby end performance 
obtains. 

Analyses of the process of skill performance and acquisition require concep- 
tual tools. For training purposes, the tools should be well grounded empiri- 
cally, and they should provide "handles" for grasping issues and guidance for 
their resolution. Further, from empirical and theoretical analyses, the con- 
ceptual tools should represent components of, or at least contribute to, the 
schematic reconstruction of the process of skill performance. 

It is doubtful that enough is known at present to support a ccmiprehensive 
reconstruction (model) of comp'iex skills* At any rate, no one has yet come up 
with one. Nevertheless, there are some excellent tentative models of cogni- 
tive behavior. Also, quite a bit is known about basic behavioral processes 
that play significant roles in all skill performance, and in a number of 
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Instances the knowledge encompasses at least the broad nature of the roles. 
With the safeguard of staying close to empirical data. It should be possible 
to attain a level of integration of this knowledge that will be valid for 
present purposes, I.e., developing rationales for the conception, design, and 
use of part-task and low-fidelity training devices. However, there are 
serious gaps In the empirical support needed for many Integrations. Until 
these gaps are closed. It will be necessary to -Resort to hypothesis and theory 
somewhat more often than might be desired. 

Ii this connection, the efforts leading to this report have concentrated on 
laboratory and related theoretical research. Studies of these types are most 
likely to Identify relevant analytic concepts and their implications for skill 
training in general. The Intent is to establish a conceptual framework, based 
on fundamental Issues in skill performance, that could help structure analyses 
of training for particular applied skills. As a result, little of the litera- 
ture cited in this report concerned applied studies of training. Such studies 
will, of course, be a concern when 'iving principles to guide equipment 
design and use, 

METHOD. The method employed in the conduct of the efforts leading to this 
report can best be described through discussions of the tasks that were 
completed and their Interrelations. In this regard, all subsequent sections 
of this report address method as they fulfill the several tasks. An overview 
of the tasks follows: 

Identification of basic behavioral concepts . This task was the selection 
and justification of the conceptual "tools" referred to earlier. The concepts 
are defined in Section II, and their value as analytic and descriptive tools 
is Illustrated. 

Analysis of cognitive skills . The analysis of cognitive skills, pre- 
sented in Section III, identifies dimensions of perfonmance that are primarily 
cognitive in nature. The analysis is in general enough terns to cover a 
variety of tasks representing a wide range of military job specialties. 
"General" does not mean "vague," however. The thrust is to identify and 
explain dimensions of task performance that apply to all skills, and in a 
manner that can focus the analysis of any particular skill. Emphasis is on 
the roles of the basic behavioral processes that, logically, must be accounted 
for. With our present enpirical knowledge regarding the basic processes, the 
kinds and levels of infonmation to be sought in examining individual skills 
can be Identified. 

Analysis of motor skills . Section IV extends the analysis in Section III 
to motor performance. Because cognitive processes permeate motor skills, 
material in Section III is pertinent. In addition, special Issues related to 
perception, coordinated movements, etc. are considered. 

Analysis of manifestations of transfer . Transfer as a basic descriptive 
concept fs discussed at length in Section II. However, that treatment does 
not go beyond traditional conceptions of the phenomenon as a pr oduc t of 
training. As will be seen, transfer as a process permeates all cognitive and 
motor behavior, including the/'>earn1ng thereor. For that reason, empirical 
manifestations of transfer are indications of the kinds of processes that were 
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involved during skill acquisition. Accordingly, Section V examines quanti- 
tative manifestations of transfer in published training data, and illustrates 
the kinds of interpretations that can be made, depending on the measures 
obtained. 

Summarization of value of analyses for ^f^^ning and training research . 
The Intent In this task, discussed In Section VI, 1s to assess the analyses In 
Sections III-V for training purposes, and to point to significant questions 
that should be resolved through research. Examples of training implications' 
appear throughout Sections H-V, so the assessment of the training potential 
of the analyses is general in nature- Three research efforts are discussed- 
These efforts are illustrative only, but each has profound implications for 
device training in general. 

These five sections present the results of the present effort. The analyses 
of skills appearing in Sections III and IV identify- performance variables 
whose development and Integration comprise the goals of skill training. The 
empirically based conceptual tools presented in Section II, and elaborated in 
later sections, can provide for the manipulation of information processing 
during training. Section V explains how results of training can be evaluated 
empirically. The Illustrative research topics discussed briefly ^n Section VI 
adopt a strategy for answering questions that can benefit the design of 
training programs and procedures for a wide variety of tasks. 
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SECTION II 
BASIC BEHAVIORAL CONCEPTS 



Modern cognitive psychology is rich in conceptions but lacking in an 
operational language that can guide manipulations of training conditions. In 
fact, only very recently has learning as opposed to perfomiance of skills been 
addressed to any great extent. The purpose of this section is to present and 
illustrate concepts that comprise a set of operational tools for guiding the 
design of training conditions. The concepts all refer to aspects of infor- 
mation processing, ^nd all till mediational roles. As treated in this sec- 
tion, the concepts are descriptive and empirical in nature. That is, the 
phenomena they identify are immediate inferences from observable aspects of 
behavior. ^ ■ 

It is necessary to emphasise at this stage the descriptive nature and 
empirical manifestations of these concepts so as to avoid unnecessary 
entanglements with theoretical conceptions. Theory will be needed later. But 
first, it is well to identify behavioral phenomena that theory must build upon 
and/or explain. Also, it is likely in many instances that, given a wise 
choice of basic empirical concepts, f-iitful analyses of training issues 
(structure of skills, training design, e^.,..) need focus only on these observ- 
able characteristics and not resort to theory. This 1s not to say that 
theories are of no value. A valid theory with an operational language is the 
most practical intellectual device known. Rather, at the present stage of 
theory development in learning, especially in psychomotor areas, theories are 
severely limited both in general validity and in operational language. 

There is a crude ordering of the basic concepts discussed below. Some, 
such as discrimination, generalization, feedback, and set are more or less 
"primitive" concepts behavioral ly. That Is, they cannot be reduced to more 
fundamental concepts without going into physiology. Other concepts such as 
cue development, learning set, transfer, and Interference, which as separate 
phenomena are Immediately inferable from behavior, can be conceived In terms 
of the more primitive concepts. "Transfer," for example, denotes generalized 
discriminations, regardless of how the discriminations are processed or the 
mechanisms of generalization. 

In addition, two concepts, skill "robustness" and hierarchical organiza- 
tion, are discussed at the end of this section. These are not learning con- 
cepts in the way those mentioned earlier are. However, they do denote aspects 
of behavior and underlying processes whose empirical characteristics need 
careful examination. In the case of skill robustness, this phenomenon is 
basic to the transfer of device training to operational equipment; and though 
it is redundant In relation to other concepts discussed, it sometimes helps 
focus attention on certain skill characteristics more clearly and conveniently 
than other concepts do* The reason for including hierarchical organization in 
this section is to provide a basis for an empirical meaning of the concept. 
Usage of the term is often vague, with no clear grounds for identifying 
empirically the essential hierarchical characteristics specified by users of 
the term. 
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The usage herein of the various terms, as Implied by the definitions pro- 
vided, 1s largely consistent with traditional usage In the psychology of 
learning. In a few Instances, however, definitions are couched so as to 
emphasize characteristics of special concern that may not have been of par- 
ticular Interest to other users of the terns (e.g., defining hierarchical 
organization 1n terms of functional :-elat1ons rather than levels). 
Furthermore, all terms are not neutral theoretically. For example, Gestalt 
psychologists would probably prefer "differentiation" to "discrimination," and 
"transposition" to "generalization" and "transfer." Admittedly, the writer's 
behavioristic and functional background led to a choice of terms common to 
these approaches to learning. Nevertheless, for the purposes of this section, 
all concepts discussed should "De considered descriptive in the sense they 
refer to phenomena recognized by all theorists. To the extent it is necessary 
later to go beyond description, the emphasis will still be on empirical rather 
than theoretical analyses to the extent data are adequate for the purpose. 

"PRIMITIVE" CONCEPTS 

DISCRIMINATION. Discrimination and the next concept discussed, generaliza- 
tion, are the two most basic concepts in behavior. One would always respond 
the saine way, or else in a truly random manner, if he could not tell the 
difference between one situation and another, and between one possible 
response and another. "Discrimination" denotes telTTng the difference in both 
instances. ("Generalization" refers to the fact that discriminations are 
repeatable as situations vary, and that they are not one-time occurrences.) 
Discriminations are essential components of all skills, and the development of 
proper cue and response discriminations is a requirement for successful skill 
training. In fact, as apparent in later sections, formulation of all the fac- 
tors Internal and external to th^ performer that govern these processes would 
be a cofuprehensive theory of skiU perfonnance. 

Except for a current emphasis on attention and signal detection in cognitive 
psychology, basic discriminative processes per se have not been the object of 
study or of theorizing except for classical work on the origins and founda- 
tions of behavior. Perhaps the reason is that in the laboratory where 
theories are usually developed, most discriminations required in studies of 
complex behavior have already been thoroughly mastered (telling one word or 
nonsense syllable from another in verbal learning; the host of prior visual- 
motor discriminations required even to qualify as a subject for a tracking 
task). Furthermore, studies have focused on simple tasks in which the addi- 
tional discriminations to be learned are also simple and clearly evident (word 
anticipation in serial verbal learning), or lumped together in a single 
measure (time on target in a tracking task). In addition, studies of complex 
skills, conducted mostly in applied settings, have largely Ignored the devel- 
opment and refinement of the basic discriminations Involved. Criteria for 
perfomance usually, and quite properly, huve been Indications of only grosser 
aspects of overall performance which are of practical Interest. 

The position taken here is that of Caro, Shelnutt, and Spears (1981): the 
complexities of military task requirements in constantly changing conditions, 
the precision of skill performance that must be maintained regardless of con- 
ditions, and the use of training devices with varying characteristics, all 
require a focus on essential cue and response discriminations. This is not to 
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sav that tasks must be analyzed discrimination by di scr1m1nat1,on. for they are 
nLrous even m simple skills. Rather, we must concentrate on factors and v 
^^HiJlnnfthat affect classes of discriminations, their development, ref ne- / 
m^nt recent 1on,'adapt^^^^^^ and, of gourse. sources of their disruption/ 
^oJ ma^y purposes, it will be necessary only to know the nature or sensory 
moSe of discHminations. plus how the nature and modes n nf .MfJJ 

Training and habituation of performance. This knowledge, especially of shifts 
in ro es is not always easily come by. The shifts hav.e been studied only to 
a limUed extent. Furthemore. we know comparatively little about propriocep- 
tion especially that derived from kinesthetic discriminations. Nevertheless. 
Jhr*succ^essful use of part-task and low-fidelity devices will require the 
aJquisit"n of skills that transcend-or in terms discussed later, are robust 
?S--Jary ng degrees of distortions in cues, responses, and conditions for per- 
Jomance. %Uimately. it is the discriminations of cues and responses that 
must be robust. 

GENERALIZATION. "Generalization" refers to the extension ^"^T^^P^"^^ 
associations across time and situations. The term will be used in its common 
emolHca sense to refer to the functional equivalence of stimuli (or individ- 
ual cues o? of responses, acr oss conditions ot and co ntexts for perfomance. 
ill ter^ necessarily implies at least a gross discrimination of a st mu us or 
I resZse or both. Thus, it is necessary to distinguish between "stimulus 
?or cue) generalization" and "response generalization." The fonner term 
refers to the functional equivalence of stimuli, that is. to the capacity of 
oSnsibly varying or entirely different stimuli to evoke the same response. 
Similarly "response generalization" denotes the functional equivalence of 
ostensibly varying or different responses that are made to a single 
Stimulus.^ 

AS explained in the introduction to this section ^^^^^^JJ^^J^" l^^^^^^'J^^^ 
viewed only in tenns of stimulus-response psychology. Such a restricted view 
iou^d destroy much of the value of the term for descriptive PU-^POses. It 
would limit "functional equivalence" to a degree of physical sim ar ty. wh ch 
Ms fully descriptive of generalization only in laboratory situations In which 
subjects (usually animals) have no backlog of appl icable experience to prov.de 
iral?zed meaning to stimuli and responses. Thus ^^^.^^^f^^" thJy "e 

Jhf task requirements cued by a single stimulus. Going one step further, a 

l^fining response generalization in terms of functional equivalence of 
responses is a deliberate departure from practice in training Psychology where 
aenerSlization implies a qualitative difference among responses. The defini- 
tlSr is nevertheless standard in experiniental psychol ogy . _ and it highlights 
most serious (valid) criticisn, of the so-cal .ed transfer surf ace 
/n!nnnH 1949) When different responses are functionally equivalent, the 
* Sa?izat'on"does not necessarily lead to a loss in positive transfer i 
may even enhance it." Also, interference processes do not always fo low as a 
fSnct on of d similarity (Slamecka & Ceraso. 1960) Functional equivalence, 
not similarity, is the 1ssue--see later discussion of transfer. 
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stimulus generated on a cathode ray tube (CRT) in a training device, and a 
mentally rehearsed response to it. can be functionally equivalent to. respec- 
tively, an instrument^ reading and a resulting actual control input in opera- 
tional equipment. Equivalence requires only an ujiderstanding of what is 
involved to complete indicated actions. 

The emphasis on generalized functional equivalence, as opposed to physical 
similarity, of stimuli or responses is consistent with what we know about 
complex behavior, especially in human?.. For some reason, in practice we have 
nevertheless chosen restrictive stimulus-response 'simll ari ty models for 
viewin-: issues of training device fidelity, recognizing all the while the 
severe limitations of the mocleU for complex behavior. Perhaps the reason Is 
the assumed lack of an analytic system, includifig an operational language* for 
rigorous conceptions of functional equivalence. Because of the lack, as 
scientists we have focused on physical similarity which can be measured more 
or less objectively. 

But an analytic system is available for establishing functional equivalence of 
sttmuli and responses. An illustration appears in the discussion of transfer 
later in this section. As will be seen, functiona/ equivalence can be put on 
quite solid logical and empirical grounds. / 



One more point should be made regarding the concepts of stimulus and response 
generalization defined in terms of functional equivalence. It may appear that 
by defining these con^:epts in a way that makes them correspondent to obvious 
characteristics of behavior, problems relative to generalizations have been 
simplified. Such is not generally the case. Rather, the complications are 
placed where they belong--establ ishing and training for the cognitive pro- 
cessing that underlies functional equivalence. A significant advantage of 
clarifying the complications is that various aspects of generalization can be 
targeted for training. They can also be researched more systematically and 
efficiently. 

FEEDBACK. "Feedback" denotes information, understandable by the performer, 
regarding the adequacy of a response or action. Whether arising from without 
or within the performer, feedback of some sort is necessary for the mainte- 
nance of skilled perfonnance and for the progressive Charlies in training 
perfonmance that lead to skilled actions. 

The concept of feedback originated in control theory where negative feedback 
fills the role of a system regulator. That is, it functions as a servo- 
mechanism to initiate corrective reactions to incorrect system perfonnance. 
The concept came into use in psychology largely through attempts to use 
control models to describe behavior (see discussion of closed-loop models in 
Section IV), but the concept was quickly adopted for more general use by some 
appl icatlon-oriented psychologi sts who had become disenchanted with the 
classical law of effect and Its successor, the principle of reinforcement. 
The value of the concept has been compromised nevertheless by equating it to 
reinforcement. Actually, feedback, as applicable to skill learning and per- 
fonnance, and reinforcement have little in common. In a Skinner box, for 
example, a reinforcer such as a food pellet is feedback only w>!an the animal 
is being "shaped," for that is the only time it communicates to him 
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Information regarding the adequacy of his actions. Once he Is shaped, food 
pellets serve only as Incentives, 

Confusion of feedback with reinforcement Is no problem In modern cognitive 
psychology, and 1t Is becoming more and more clarified In psychomotor skills, 
at least In basic research. Training literature, however, Is still rife with 
"principles" of feedback that actually apply only to reinforcement. It Is 
necessary to maintain a careful distinction between these concepts. Further, 
It Is necessary to distinguish among the different roles of feedback Itself. 
For example, feedback as a servomechanism and feedback as "knowledge of 
results" (KR) follow quite different laws. KR can be equally effective over a 
wide range of delays In availability, or when presented In a variety of forms. 
In fact, Kulhavy and Anderson (1972) and Sturges (19^69, 1972) have shown that 
delayed feedback actually enhances retention of some knowledge (see Section 
III) . When In the role of a servomechanism, however, any perceptible delay of 
feedback can be devastating for some skills, and the forms of Its presentation 
(e.g., particular sensory modes) are often severely restricted. Such dlf- 
fererces In the roles of foedbeick can be critical for training with part- task 
and low-fidelity devices. For example. In later discussions it will be 
apparent that permissible delays in and forms of feedback are far more 
restricted for skills confonmfng to a "closed-loop" model than for skills that 
fit "open- loop" models. 

Questions regarding the. value of platform motion in flight simulators further 
illustrate the need to analyze the roles of feedback. In their reviews of 
research on the effects of platform motion, Gundry (1976) and Caro (1977) 
attempted to resolve discrepant research data by distinguishing between 
maneuver motion and disturbance motion. The former results from control 
inputs, and hence comprises feedback within the control loop. On the other 
hand, disturbance motion such as may arise from air turbulence or engine 
malfunctions is not actually feedback. It is an indication of the status of 
the aircraft relative to the flight environment. In other words, maneuver 
motion, either as a servomechanism or KR, Is feedback--1nformat1on regarding 
;j adequacy of ongoing control Inputs that can be used to monitor, fine- tune, 
and correct them. Disturbance motion is an external cue signifying the need 
for a new control input. 

On the basis of previous research, both Gundry and Caro concluded that 
maneuver motion was not of general benefit in a flight simulator, at least for 
stable aircraft, because it duplicates feedback available from Instruments and 
other visual displays. However, Gundry (1976) in his review identified a 
variety of effects of motion on pilot response. Including a closer correspon- 
dence of high frequency, low amplitude movements between simulator and flight 
control manipulations than was the case with no platform motion. On this 
basis, Gundry felt that motion as accelerative cues might be beneficial when 
unstable aircraft are simulated because high frequency Inputs are needed. 
■ Caro (1977) also felt that accelerative motion cues might help when simulating 
unstable aircraft; and in a later paper (Caro, 1979) he related the possible 
beneficial effects to the fact that reaction times are more rapid to motion 
than to visual cues. In this case, aircraft instability per se would be only 
a special case of the need for platform motion. As Caro (1979) pointed out, 
motion may also be valuable, for example, in correcting for torque- Induced yaw 
when taxiing a helicopter. 
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It Is apparent that the roles of feedback can be complex, and that how It 
should be provided in training devices depends on a number of factors related 
to Its roles and alternative ways of providing it--visual cueing for maneuver 
motion, g ^.seats for dccelerative cueing, etc. (It is also apparent that the 
distinction made earlier between maneuver motion as feedback and disturbance 
motion as new information breaks down in soiiie cases. Are the reactions of an 
unstable aircraft maneuver or disturbance motion, feedback or new signals?) 
The extent to whicL the functioning and roles of feedback must be analyzed to 
derive training principles is noc yet clear* For the multidimensional cue- 
response systems of many complex skills, the roles of feedback appear to have 
hierarchical characteristics in wnich the interplay of feedback as servo- 
mechanisms and as KR is quite cjmplicated (and poorly understood) ♦ Further- 
more, the functioning and role of feedback for a given skill often change 
during skill acquisition. This is especially true when trainees must learn to 
recognize and Interpret stimuli that only after practice become feedback cues 
(see Cue Development). Early in training, they may need augmentation of 
naturally occurring feedback so as to enhance discrimination of it; or^they 
ma^y have to depend on artificial feedback provided by, say, visual cues, to 
guide the learning of proprioceptive cues such as the "feeV of a correct 
restfonse. (This process would characterize learning of open-loop* skills 
which, early in training, function as closed loops,) 

Castellan (1977) raised still more questions regarding the operation of feed- 
back, especially the lack of systematic effects on final performance levels. 
Again, the extent to which the functioning and roles of feedback must be ana- 
lyzed for present purposes is not yet clear. The broader scope of the problem 
is evident in later discussions 

SET. "Set" refers to a predictable, transitory tendency to perceive, react, 
or otherwise respond in a certain way, given certain conditions. Sets are 
inferred from cue sensitivities, response consistencies, and manipul atable 
conditions that establish them. In the past, they have been a basis for 
explaining positive and negative (interfering) transfer, attention, and the 
effects of guidance on learning. Sets are implicit in all theories of cogni- 
tion. Some current models of motor , performance invoke this concept to over- 
come difficulties in explaining selective attention and response initiation. 
In other words, "set" has been and continues to be viewed as a basic mechanism 
in behavior. There have been numerous studies of how sets are established and 
how they affect behavior. Nevertheless, "set" continues to be a relatively 
primitive, i.e.. nonreducible, term because its underlying nature is not 
known. It is an empirical reality nevertheless, and as such denotes manipu- 
1 atable conditions that affect, and are affected by, learning. (See al^o 
"learning set.") 

HIGHER-ORDER CONCEPTS 

CUE DEVELOPMENT. Cue development depends on three factors: (1) the acquisi- 
tion of meanings for stimuli in the context of goal-oriented behavior; (2) the 
association of a class of responses appropriate to the context; and (3) the 
generalization of the stimulus meanings and associated responses across time 
and situations. In other words, a cue is more than just a meaningful stimu- 
lus. The meaning must Include means-ends relations which call for adaptive 
actions. Recognition that a compass reading indicates an Incorrect course 
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does not comprise a cub unless the pilot knows what to do about It, and can do 
it in any number of situations. Therefore, "cue development" refers to the 
acquisition of entire complexes of the three factors mentioned. 

Cue development (and by impl ication, cue) was defined in this way to emphasize 
the complexity of this aspect of skill training. The simplicity of the com- 
pass example notwithstanding, cue development is a much -more coniolex phenome- 
non than discussions of it in training literature might suggest. In fact, 
explaining what is involved in even the simple compass example would require 
analyses of cognitive processes that go far beyond the level of description. 
Failure to come to grips with these complexities, has prevented an analysis of^ 
cued behavior needed for train. ;ig in general, and device training in par- 
ticular. In one attempt to show what is needed. Stark (1976) presented an 
informative discussion of visual cueing in aircreft and simul ators in which 
the complexities involved were clearly recognized. However, in spite of a 
fairly sophisticated analysis of a problem involving cueing. Stark did not 
focus on information processing, the heart of cueing. 

Cue development in general follows patterns of discrimination learning. 
Pertinent stimuli and their variations must be differentiated within the con- 
text of the goals of performance, and their implications for response selec- 
tion and monitoring recognized (response discrimination). As cueing systems 
develop, individual stimuli and stimulus patterns may result in cues for the 
onset of an action, or provide bases for the feedback cues necessary to moni- 
tor the responses comprising the action. Depending on the complexity, includ- 
ing duration, of skill performance, the sequencing and timing of responses 
must be sensitive to oft^ subtle variations in internal and external stimulus 
conditions, with timely differential responses available as changing 
conditions require. 

Obviously, any purposive action above the level of a reflex involves complex 
generalized discriminative systems for cueing and responding. And if it were 
not for the fact that persons undergoing training have a life-long mastery of 
a variety of basic coordinated cueing systems at the outset, skill training 
would be a hopeless endeavor. 

Because trainees start with a repertoire of mastered cueing systems, training 
designs have assumed in effect that, given enough opportunity to practice a 
skill under the right conditions, any qualified trainee will eventually 
develop the refinements and generalizations of existing cueing systems 
required for successful performance in the tasks being trained. Much more can 
and will be said. Furthermore, when training with a low-fidelity device or 
even a part-task trainer, "right condi tions" become a major concern. For a 
given stimulus condition in actual equipment, and for a given response 
requirement, how might training be designed so as to help the trainee select 
the most appropriate, previously mastered behavioral systems on which to 
build? Also, what varieties of stimulus conditions and/or responses in a 
device might be used such that a skiT learned in the device has the 
topological properties required for performance in actual equipment? 

An example will help, clarify these questions. A pilot trainee starts with a 
highly complex set of alternative cues for distance, and with well habituated 
systems for using them in various combinations. One wishes to design a 
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low- fidelity /visual system for a flight simul ator that will be adequate for 
cueing depth-rel atod performance of certain tasks in the simulator, and for 
transferring the cue-response relations learned therein to performance j an 
aircraft. Of the various depth cues habitually used by a pilot trainee, 
linear perspective is not only an important cue, its essential topological 
property, convergence with distance, can be provided relatively easily in a 
simulator. Say with a checkerboard ground scene (Stark, 1976). Insofar as 
skills learned using the checkerboard cue? can be transferred without serious 
disruption to cues derived from apparent convergence of highways, power lines, 
vegetation patterns, etc.. during flight, the simple visual scene will have 
served its purpose. Note that another habitual depth cue, apparent size of 
objects, coulu have been added tj the simulated visual scene, although at some 
additional expense. The question is, what partial cues are needed in a 
simulator to ensur<? intact cue-response transfer when all cues are available 
in the aircraft? 

The approach to devic? design has been to seek fidelity of cueing systems- 
highways, etc., rather than checkerboard patterns--compromi sing only as avail- 
able technology and costs dictate. There '1s ho question that fidelity is 
critical for some training; but it 1s not for other training, and v^e do not 
know in general what the difference is. Analyses of topological properties of 
cueing systefi)S (see later discussion of transfer) would aid In identifying the 
difference. 

LEARNING SET. As usually studied by functionalists during the fi^st half of 
this century, sets as defined earlier were manipulatable states in subjects 
that could be altered either through Instructions or by arrangements of 
experiences during learning. In either case, they governed attention, 
transfer, etc., as these latter variables affected peVfonnanGe on specific 
tasks. In this light, effects of sets are hardly profound enough to account 
for the pervasive influences of experience that result in a high degree of 
consistency of performance among a variety of tasks. Neither are the effects 
at a level of generality sufficient to explain how past experiences of a 
diverse nature can be selectively brought to bear on a novel probl(^. In 
other words, while sets obviously govern cue processing and response selection 
In specific situations, what controls the sets? 

In this context, the answer is "learning sets." The tenm refers to a class of 
enduring phenomena that are characterized by consistency of performance across 
a variety of tasks, and by the selection of aspects of past experience that 
are to be brought to ' bear on even novel problems. ^ At the risk of over 
simplification, the difference between "set" as usually used and "learning 
set" is illustrated by the simple instruction, "think opposites." A subject 
so instructed, when presented the stimulus word "big," will likely respond 
"little" or "small." Had the inscruction been "think synonyms," the respon^s^^ 
would have been "large" cr "massive." The instructions induced sets in the 
olde>* sense of the term, i.e., transitory states of readiness and Infonnation 



As the term "learning set" implies, laboratory study of these phenomena 
has focusef^ on thei r cumul ative effects on discrimination learning. For the 
same reason they are often referred to as "di scriminaticn learning sets" and 
"learning t.j learn." 
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processing 'that could be changed by a new instruction. But the predisposition 
to follow instructions, whatever they might be, is a learning set . Learning 
sets are thus generalized discrimination systems characterized by (1) high 
orders of consistent infonnation processing, and (2) stability of functioning 
across time bkause of habituation. In this light, they are basic not only to 
transfer, but to retention and rapid relearning of ''forgotten" skills. They 
can also introduce habitual modes of processing infonnation that, due to their 
rigidity, interfere with adaptive learning and performance. 

Harlow's 11949) review of experiments by him and his coworkers demonstrated 
the empirical real ity of these higher order sets. Their signi ficance for 
understanding complex behavoor is evidenced by their incorporation into 
theories of cognitive processing (e.g-, Ausubel , 1968; Gagne, 1962, 1965, 
1968; Gagne & Paradise, 1961; Hunt, 1961; Handler, 1962; Mayer, 1975; Postman, 
1969; Travers, 1963). In fact, Wolfgang Kohler, the leading living proponent 
of Gestalt theory at the time, readily admitted that "insight"--the classical 
Gestalt explanation of , problem sol ving and transfer--had been an inadequate 
concept, and that learning sets were likely the bases for insights (Kohler, 
1959). 

It is surprising that systematic use of the concept of learning set has not 
been greate than it has, at least in cognitive theories. The concept is 
neutral theoretically, well grounded empirically, and it is "ready-made" for a 
class of concepts discussed later: "nonspecific" transfer, "figural" trans- 
fer, and "far" transfer. But ^ the analytic power of the concept goes far 
beyond these concepts of transfer. In 1820, Thomas Brown (1820/1965) called 
the British Empiricists to task for neglecting ^sufh-^a^ logical ly necessary 
aspect of association. As an empirical concept, learning sets are operational 
handles for conceptions of the role of past experience in behavior ranging 
from "formal discipline" explanations of transfer to John Dewey !s logical 
analyses of experience and education. Although they often miss the empirical 
advantage of the tr'oncept, modern theories of cognition do generally Incor- 
porate concepts such as analogical schemata that are of the nature of learning 
sets. ' . X '-^ , • 

On the other hand, theories of motor learning as a rule do not use this con- 
cept, nor in most instance's even Incorporate processes analogous to it. This 
omission might be less surprisin^^ , than in the case of cognitive theories. 
First, unlike cognitive skills, motor skills seem to be task specific. That 
Is, intertask performance of a motor nature has been found to correlate very 
Vow from task to .task, which is not true for cognitive tasks. Second, learn- 
ing sets involve processes at least partly^ probably mostly, in the cognitive 
i domain;, and while modern theories of motor skills recognize fundamental roles 
f for cognition in motor performance, 1nji:luding schemata, they do not yet spec- 
' ify the roles in a way that defines them cleiarly, much less a way that leads 
to an empirical ' (operational ) language, third, theories of motor functioning 
have been based mostly on data concerning simple sk.il 1 s, • observed over a short 
period of time. Thus, , as in the bulk of temporal lyjlmi ted stlidies of verbal 
learning, "set" has been a useful concept In motor learning and performance 
(e.g., for postural motions. Smith A Smith,. 1966^ p. 360; for monitoring 
skills. Summers, 1981); uut "learning set" has not .because, to be of value, a 
variety of skills must be learned by leaph subject, and over a longer period of 
time than that usa^i^ly devoted to an, experiment. 

ERiC " " 27 ^ " . ^ 
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While these three reasons may explain why learning sets have not been of 
interest in theories and models of motor skills, they by no means imply that 
these phenomena have no role in the motor domain. As for the low Inter- 
correlations of performance across motor tasks, low i ntercorrel ations charac- 
terize cognitive performance too when the tasks are simple relative to the 
maturity and experience of the subjects, or when the ability range of the sub- 
jects has been severely restricted through the mode of their selection. The 
low correlations follow directly from the lack of variance in performance. No 
one knows the magnitude of i ntercorrel ations that might be found in motor per- 
formance if, as has been done e/tenslvely for cognitive aptitudes, motor 
"problems" (tasks) covering a wide range of graded difficulty levels were pre- 
sented to subjects of a wide .ange of ability levels. (Even so, Zavala, 
Locke, Van Cott, and Fleishman [1965] found sufficient i ntercorrel ations among 
flight skills for a selected group--hel icopter pilots--to justify elaborate 
factor analyses.) Judging from common ostensible differences in general ath- 
letic ability alone, there must be a level of consistent processing of motor 
performance that transcends movement and manipulative skills specific to indi- 
\ vidual tasks. Learning sets may not be the critical mechanisms in the higher 

order processing, but they cannot be dismissed summarily. Nor, as has^ been 
the tendency, should possible intercorrelations among complex skills be 
ignored just because low intercorrelations were found among simple skills. It 
is important to keep an open mind regarding the i ntercorrel ati on of complex 
skills, for there is too much at stake to Ignore possible inter-skill rela- 
tions. Not only must vertical and cross-skill transfer (see below) be 
accounted for, it must be understood for optimum training. 

The probable value of learning sets as explanatory concepts in motor perfor- 
mance is more readily apparent in other areas. For example, "schema" models 
of performance as explained in Section IV depend extensively on hierarchical 
cognitive processing. That is, higher levels of processing supposedly 
"assess'' task requirements and govern the ''selection" and "tailoring" of skill 
complexes to the requi rements* In other words, schemata are highly genera- 
lized discrimination hierarchies; and depending on the situation, they can be 
bases for any manifestation of transfer. 

At present, concepts of schemata are fairly well developed in cognitive theory 
but not in models of motor performance. They are assumed in motor performance 
because somehow we must recognize the versatility of skill utilization, and as 
expl aired later, hierarchical schemata overcome the limitations of ''loop" 
models in this regard. However, there has been practically no research on the 
development of motor schemata, the most crucial issue for training. It may 
well be that what schema models offer to training can be realized by empha- 
sizing the similarity of their presumed processing of Information to that of 
the more empirical concept of learning set. By comparison, we know quite a 
bit about the development of 1 earning set: and conditions governing their 
effects on behavior. By substituting a functional analysis of schematic pro- 
cesses for current speculations regarding their structure whether In cognitive 
or motor performance, schemata and their development can Hkely become 
tractable goals for training. 

These examples Illustrate how learning sets, as analytic tools, can be of conr 
siderable value. The examples do not exnaust possible uses of the concept, 
however. Spears, Sheppard, Roush, . and Richetti (1981, Part I, p. 85-4f) 
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Identified a variety of possible applications: Factors affecting training 
such as students' learning styles and their past experience should be at least 
partially reducible to parameters conceivable as learning sets; many cue para- 
meters, including "similarity" relations 1n device fidelity, can certainly be 
so reduced; our knowledge of the development of learning sets should be, 
though It Is not at present, exploited for designing training, scheduling 
practice, selecting sequences of tasks to be practiced, even defining inter- 
mediate standards for performance, as might be applicable, say, to part-task 
training. Spears et al . may have been a little overenthusiastic in that 
empirical reductions of these matters to learning sets have not yet been 
attempted. Nevertheless, just knowing that learning styles, for' example, 
appear to exhibit all the cnaracteristics of learning sets suggests imme- 
diately the di ff icul ties- -unto futil i ty--that can be involved in designing 
training equipment, intentionally or unintentionally, that is efficient only 
for particular styles. Thoroughly habituated ways of processing information 
are difficult to change. (Try not to think opposites when so instructed.) A 
training device for which a given learning style is not appropriate may 
require more instruction to change the style in the learner than the effort 
and device are worth. 

TRANSFER. Transfer of training is widely recognized as the critical factor in 
the successful use of training devices. The position taken here, and 
demonstrated later, is that transfer in some form is the critical factor in 
all training, including that with actual equipment, because it permeates all 
'EeFTavior. This position is implied in just about all modern cognitive 
theories, and it has been occasionally emphasized in applied training (e.g., 
Blaiwes, 1970). Nevertheless, it was not common in educational psychology 25 
years ago (Spears, 1961). 

With this view, it is difficult to separate descriptive uses of the term and 
those that go beyond , immediate inferences from observations. Therefore, the 
discussion that follows does not adhere closely to a descriptive-explanatory 
dichotomy for the concept. Instead, the discussion focuses on certain points 
that will help clarify the uses of other descriptive terms. The treatiient is 
traditional at this time, however. In Sections III and IV transfer assumes a 
more comprehensive role. 

Transfer and Identical Elements^ Because of their profound influence on 
thinking regarding device training, it is Important at the outset to meet 
"identical elements" theories of transfer head-on. In doing so, perhaps these 
conceptions can be laid to rest Insofar .ahs the present effort is concerned, 
thus avoiding the necessity for redundant explanations and qualifications when 
analyzing skills. 

Formulations of theo^ries of common elements date to the turn of this century. 
The most sophisticated models, and the best grounded empirically, are those 
presented by Osgood (1949) and Houston (1964). It is necessary to consider 
only the former, for Houston's model is similar in conception. Extrapolating 
from numerous studies of facil ttation and Interference in (mostly) verbal 
learning, Osgood developed a three-dimensional "transfer surface" in which 
positive-negative transfer comprises a dependent dimension, with degree of 
stimulus similarity, and a gradation of response characteristics, comprising 
two independent dimensions. Generally, degree of positive transfer is 
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directly related to stimulus similarity and to response similarity, being 
maximum when learning and transfer stimuli and responses are identical, and 
taoerinq off as either transfer stimuli or responses are reduced in simi- 
larity Unlike tne stimulus dimension which is graded entirely as degree 
similarity the response dimension merges f.'om "similar" through "dissimilar" 
and "opposition" to "antagonism." As a result, negative transfer Is greater as 
learning and transfer stimuli increase in similarity, conjointly with 
responses becoming oppositional or antagonistic. If stimuTT are totally 
disslmiliar or if responses are at some borderline point of dissimilarity, 
transfer is zero. That is, prior learning does not affect perfomance on a 
transfer task. Although some,''-iat oversimplified, this description of the 
transfer surface is adequate for present purposes. (It also goes as far as 
typical training conceptions of the model do.) 

In past applications of the model to device training, similarity has been 
defined largely in terms of degree of physical correspondence of stimuli and 
of responses (and with no distinction between dissimilar responses and those 
which are oppositional or antagonistic), antagnostic) . Hence physical fidel- 
ity of stimuli, and task fidelity of responses, have been emphasized in device 
design. (Task fidelity in this context requires both physical fidelity of 
manipulanda and functional fidelity of actual or simulated device operations.) 
It Is widely recognized that a physical interpretation of similarity is 
unrealistically restrictive. Yet it is not uncommon in the literature on 
device training for an author to delineate shortcomings of the model, and then 
adopt It uncritically for analyses of device characteristics (e.g., Wheaton, 
Rose, Fingeman, Korotkin, & Holding, 1976). 

Put bluntly, most criticisms of Osgood's model are not relevant. While even 
as a behavioristic conception the model has serious limitations-- the failure 
to account adequately for the positive as opposed to negative role of response 
generalizations, for exampl e--they do not reside in the presumed requirement 
of physical similarity. As Osgood illustrated (Osgood, 1952; Osgood, _Suci. & 
Tannenbaum, 1957), "stimulus", "response", and the relation similar should 
be treated as undefined terms. (He did not call them this, but to the extent 
he utilized the model and its implications In the later writings, these were 
undefined terms in the logi co-mathematical sense.) To apply the model, it Is 
necessary to map one-to-one correspondences of undefined terms in the model 
onto the behavioral domain. 

An excellent example of what is involved in a formal mapping is provided in 
the first chapter of The Measurement of Meaning (Osgood et al . , 1957), 
although the process is" not referred to as mapping there. For example, two 
"stimuli" (adjectives ifor Osgood et al.'s purpose) are 'similar (functionally 
equivalent in meaning) to the degree they evoke the same response 
(associations), have the same generalization and Interference characteristics, 
etc In the (transformed) language of the transfer surface, " when a sign or 
assign is ronditio ned to a mediator. It will also tend to elicit otTier 
mediators in pr oporti on to their similarity to tne original reaction and wfll 
tend to inhibit othe r" mediators in proportion to the directness of the ir 
•anfaq ohism. or opposlteness. to the original reaction . . ." tusgooo et ai.. 
195V! p. 14; Italics in the original K 
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This statement, presented as a general law, obviously would make certain 
mediation&l processes--and functional equivalence of stimuli and responses-- 
the focus of transfer. If a buzzer in a device, and an out-of- tolerance 
reading on an actual instrument, are associated with the same mediators, they 
will produce the same response; if the mediators are, in turn, associated with 
a class of functionally equivalent responses, any one of the responses may be 
produced, depending on circumstances. The general validity of Osgood et al.*s 
**law*' may well be questioned. In fact, it appears naive in view of modern 
conceptions of cognitive similarity (cf. Ortony, 1979; Tversky, 1977; Tversky 
& Gati, 1982; see also Section III). The point is, however, that the origi- 
nator of the transfer surface recognized the need to translate it into--map it 
onto—behavior, and in a way that the mapping conforms to specifiable 
empirical criteria. 

One might still say that the transfer surface is an identical-elements model, 
with mediators now the elements. Furthermore, in the exchange, objectivity of 
stimulus elements and some response elements has been traded for unobservable 
internal events. While true, the exchange at least recognizes the complexity 
of human behavior, and it formally permits people to transfer learning as they 
are going to do anyway. (One is reninded here of Kdhler*s [1959] complaint 
that psychology is the only science that has made content secof:dary to 
methodology.) At any rate, there is an empirical safeguard in that 
specifiable relations in overt behavior must obtain. 

It is not necessary for present purposes to take a stand for or against this 
formal extension of the transfer surface. The purposes are accomplished if 
the earlier use of "functional equivalence" in definitions of stimulus and 
response generalization is seen as justified; and if later analyses of mecha- 
nisms and dimensions of transfer (and interference) can be accomplished 
without undue dependence on physical characteristics of events except when 
they are critical (e.g., harmonic temporal phasing of negative fe"e3[5ack when 
it acts as a servomechani sm In a coordinated harmonic action). 

The Phenomenon of Transfer . To return to a more general di scussion of 
transfer, the term w1 1 1 5e" used to imply a complex of generalized cue and 
response discriminations. Or stated differently, transfer resul ts_ from_^_^^ 
generalized discriminative system . Transfer is general i^-^^-ion; the di fference 
in usage of the two terms aepends only on Ihe cunipieA.ty, including pat- 
terning, of the generalizations involved. While a single term might be 
desirable, this distinction conforms to ^itional usage of the terms. It 
also facilitates communication and analysis, i or example, factors affecting 
transfer as a system of generalizations in all likelihood affect separate 
constituent generalizations differently. Thus, in discussing the effects of 
various training ano equipment variables on transfer and generalization, the 
choice of terms, transfer or generalization, will help the reader recognize 
whether the effects under examination are to be considered gross in nature or 
specific to individual components of behavior. 

The Identification of transfer w1 th general izatlon leads immediately to the 
Inference that transfer permeates all complex behavior. In other words. It is 
the process whereby past experience Influences subsequent behavior. While 
true, there could be a danger here of vitiating specific uses of the concept 
by extending It to a general theory of behavior. There Is little 
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justification for such an extension, and it would be of no use for present 
purposes. The significant thing is that transfer is Involved in all learning 
beyond the earliest conditioned reflexes. One learns by assimilating new 
information into existing behavioral and cognitive structures; by extending, 
refininq, and adapting existing discrimination systems; by adapting existing 
response' systems to new cues, and existing cue systems to new responses; etc. 
Obviously, the efficiency, and ultimate achievement, in learning depend on 
what the 'learner had to start with, and on additiinal foundations developed 
and elaborated during training. 

These points are generally recognized; they have not been fully exploited, 
however. As Royer (1979) and Caro et al . (1981) explained, we have treated 
transfer primarily as a product of training, ignoring the fact that an 
understanding of transfer as a process of learning could improve both the 
training and the product. 

Types of Transfer. Various authors have proposed distinctions among manifes- 
tations of transfer. While none of them are particularly good for analytic 
purposes, a brief review of the distinctions will reveal the range of 
phenomena that must be considered when analyses of skills are attempted. The 
product versus process distinction was just mentioned. A much older distinc- 
tion is "specific" versus "nonspecific" transfer (McGeoch & Irion, 1952; 
Royer, 1979). Specific transfer is that across similar situations, for 
example, frdm a simulator to the operational equipment simulated. Nonspecific 
transfer occurs across dissimilar situations, and thus necessarily involves 
highly generalized discriminative systems, such as general principles that can 
be applied to a number of different situations. It is not restricted to prin- 
ciples, however. Nonspecific transfer would generally result from the 
establishment of any general learning set. 

The distinction between "near" and "far" transfer (Mayer, 1975) also focuses 
on the situations involved. Near, like specific, transfer is that across 
highly similar situations. Far transfer fills a niche between near or spe- 
cific transfer and nonspecific transfer. Far transfer situations are 
generally more different than those defining near transfer, yet there can be a 
c OTMn al i ty b'el 6w"t )re~"TeTe T "^^^^ 

transfer. Far transfer would also be influenced by learning sets, however. 

"Lateral" versus "vertical" transfer (Gagn'e, 1965) is a distinction very simi- 
lar to the product-process dichotomy. Within the structure of learning 
hierarchies as viewed by Gagn'e, vertical transfer is the process whereby 
achievement of skills lower in the hierarchy facilitate the learning of higher 
skills. Vertical transfer is thus more restricted than process transfer which 
does not depend on a learning hierarchy. On the other hand, lateral transfer 
could encompass product transfer as well as nonspecific transfer. 

The distinction between "literal" and "figural" transfer (Royer, 1979) focuses 
on the skills being transferred instead of the situations and contexts in 
which transfer occurs, thus opening up a new set of considerations. Literal 
transfer involves an intact set of skills (product) such as a standard routine 
for isolating a fault during troubleshooting. That is, the content of the 
-behavior involved is essentially the same regardless of the occasion. Figural 
transfer Involves flexible behavioral systems that can be combined and 
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recombined as conditions warrant, as would be required for fault isolation 
involving logical analyses of equipment functioning. 

Although it is not apparent in this brief review, most of these conceptions of 
transfer were devised to fill particular needs related to the kinds of 
learning of concern to their originators. (Generally, the originators were 
concerned with cognitive learning.) It is interesting that, except for 
Gagne's vertical transfer, only the product-process distinction sought to 
highlight the role of transfer In the acquisition of learning. As will be 
demonstrated in Section III, al 1 of these conceptions are actual 1y quite 
crude. They derive from gross behavior, not Its mechanisms. 

INTERFERENCE. "Interference*' refers to a relation among separate cue-response 
systems (or subsystems) such that the existence of. one system results in 
degraded performance in another. Obviously, interference can be expected to 
the extent two concurrent cue-response systems are physically Incompatible 
with each /other. In skill perfonnance, interference due to physical Incom- 
patibility can be avoided only by designing operational equipment and/or tasks 
in such a way that no two Incompatible actions need occur at the same time. 
Hence, incompatibility is a concern primarily in analyses of human factors 
Involved in equipment and task design. The present Interest In interference 
is its effects on the performance of skills that are not Intrinsically 
incompatibl e. 

Interference among physically compatible skills Is a major problem in 
training. Skills that do not lead to interference in expert perfonnance may 
still pose major difficulties in acquisition and retention because they are 
Interfering to nonexperts. As explained in Section III, interference is a 
very complicated phenomenon. It can arise at any of numerous stages of infor- 
mation processing, and it can be beneficial as well as disruptive in skill 
perfomiance. But wherever it occurs, disruptive Interference Indicates inade- 
quate discriminations, whether of cue interpretation, response selection and 
adaptation^ preparatory sets, or any other mediational component of infor- 
mation processing. The faulty di scrfminations may be due to inadequate oppor- 
tunities to learn (and make habitual) the discriminations in the first place; 
to overgeneralizations (negative transfer) of cues, responses, etc., of one 
skill that obscures unique aspects of another; or to internal and external 
conditions (anxiety, unexpected events, etc.) that result in reactions other 
than-those jLnv„oJ_yjELd 1 n„.s^^^ 

A lot of research has been done on the nature of interfering processes, their 
effects on performance and retention, ways to avoid and accommodate them, and 
how to remove them when originally Interfering skills are to be integrated 
into a more comprehensive skill or time-shared perfonnance. This research 
will not be reviewed here. Rather, the present discussion will highlight how 
knowledge of interference can aid in the design and use of part-task and 
low-fidelity training devices. 

First, specific limitations of existing models of skill performance are per- 
heps best revealed by their failures to account for patterns of Interference 
that have been well established empirically. Knowing these limitations as 
they apply to individual models will help avoid unwarranted extrapolations of 
the models to the design and use of training devices. Second, patterns of 
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Interference that have been observed could help in topological mappings of 
cue-response systems across training devices and actual equipment, as 
discussed in connection with transfer. For example, to justify empirlcany a 
mapping of the transfer surface (Osgood, 1949) onto behavior, functional 
equivalences of interferences of cue-response systems must obtain. 

Third, practice conditions that minimize Interference can guide the selection 
of tasks for training with part-task devices. For example, two tasks that 
must eventually be perfonmed together, such as flight control and communica- 
tion with the ground, may be mutually interfering during acquisition. For 
many tasks, the interference can be reduced if one or both are first mastered 
separately to some minimum level before Integrated practice is attempted. A 
fourth value of data regarding Interference is closely related to the third. 
It is based on the fact that, as a general rule, tasks are less mutually 
Interfering to the extent they depend on different modes of processing (visual 
versus aural feedback; verbal versus kinesthetic cueing; etc.). Thus, even 
though two tasks must eventually depend largely on the same modes, early joint 
practice of the tasks may be more efficient if practice conditions pennit 
aural feedback for one task, for example, even though both depend ultimately 
on visual feedback . 

A fifth, and major, value of previous research on interference derives from 
the relation of interference to retention and transfer. As for retention, the 
only comprehensive "theory" of forgetting- -the Inverse of retention--1s an 
interference theory: things are forgotten, skills become degraded, etc., 
because, over time, subsequent or even previous learning and behavior competes 
wUh a* given skill such that discriminations among skill-unique cues, 
responses, mediators, etc., become obscured. The difference between skill 
"degradation*' and ostensible "forgetting" of the skill is thus seen as a 
matter of degree. As evident from studies of relearning, skills are never 
completely forgotten. They appear so because interference is at a level that 
observable response production is absent or at least highly erratic. 

Negative transfer by definition results in interference. In fact, there have 
been occasional allusions to negative transfer as the "vehicle" for inter- 
ference effects generally. However, as stated earlier, with our present level 
of knowledge there is nothing to be gained by making transfer a general theory 
of skill perfonnance. In the present case, it is better to view skill degra- 
dation and forgetting as an obscuring of discriminations, and negative 
transfer as the direct competition of actions, all of which may have clear-cut 
discriminations. The fuzziness of this distinction notwithstanding, it does 
help focus training Issues on empirically established effects of interference 
that relate specifically to retention £r to negative transfer. 

ADDITIONAL CONCEPTS 

SKILL ROBUSTNESS. "Robustness" as used here is a term borrowtd from statis- 
tics. In statistics, it describes an analytic procedure whose validity is not 
noticeably affected by appreciable violations of assumptions underlying it. 
By extension, its use to describe skills (e.g., Thorpe, 1978) denotes the 
adaptability of skilled perfonnance to a variety of situations in which cues 
have unaccustomed, even distorted, characteristics, and/or in which responses, 
must change qualitatively or quantitatively to achieve a desired end. Thus, 
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skill robustness implies functional equivalence among a variety of stimuli and 
a variety of responses involved in performance. 

As a descriptive term, "robustness" is especially useful for present purposes 
because it designates a class of skill characteristics (1) that should be a 
goal in all training, and (2) that are crucial to successful use of part-task, 
and especially low-fidelity, training devices, A person with robust skills 
would experience less interference and hence would have less of a retention 
problem, could apply the skills in a variety of ever changing situations, and 
could transition from one configuration of equipment to another (e,g., one 
type of aircraft to another type) with at most only temporary degradation of 
perfonnance. As for training with certain low-cost devices, skill robustness 
ipso facto is necessary for transfer of training to actual equipment. 

Prophet et al • (1981) pointed to the need to understand, and to train for, 
skill robustness. The present effort pursues both goals as they relate to 
device training. However, the concept has value for other purposes as well. 
For example, among the models of motor skill performance discussed in Section 
IV, the critical shortcoming of closed- and open-loop theories, and to some 
extent, "channel" theories, is their inability to account for skill robust- 
ness. Schematic models on the other hand address robustness directly. Skill 
robustness thus can be a basis for evaluating models of skills as guides for 
the design and use of part- task and low-fidelity devices. (The concept also 
helps focus analyses of skills as illustrated later.) 

HIERARCHICAL ORGANIZATION. This tenn will refer to an organization of skills 
or of skill components which is defined by more or less rigid functional rela- 
tions. Most models of cognitive skills make extensive use of hierarchical 
structures. They are much less common in motor theories. 

Typically, hierarchical organization is conceived in terms of "levels," which 
in turn represent an order of inclusiveness or implication. For example, the 
ability to land an aircraft successfully includes, or implies, at least mini- 
mum skill in manipulating aircraft controls. Thus, landing an aircraft may be 
considered at a higher level in a hierarchy of flight skills than control 
manipul ation. 

There is an obvious difficulty in such an inference, and the problem illus- 
trates the reason for the definition of hierarchical organization in terms of 
functional relations as given in the first sentence above. For example, motor 
skills, at least for certain sets of tasks, tend to be largely independent of 
each other. Strictly speaking, landing an aircraft implies competent control 
inputs only for those inputs involved in landing. It does not imply proper 
use of controls for other maneuvers. 

The concept of skill hierarchy will be fruitful not only for understanding 
skill organization but for identifying separate tasks as candidates for part- 
task training. If a higher-order skill implies, i.e., requires, lower-order 
skills, the ]atter can be learned in a device that does not train the more 
comprehensive skill. However, it will be necessary "to specify clearly the 
nature (and limits) not of levels b^jt of funttional relations that define 
hierarchical organizations. And aside from an ^immediate concern with part- 
task training, conceptions of hierarchical structures in models and other less 
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formal accounts of skill learning represent a variety of possible relations, 
some of which have nothing to do with levels or implications. It is important 
not to confuse various conceptions by lumping posited functional relations 
among ski 1 1 s ana ski 11 components together under a si ng 1 e set of rel ations 
such as 'Heveis," 

Gagne*s (1965) learning hierarchies are a case in point, "Levels" are 
established to the extent that prior mastery of a given skill is a necessary 
condition for mastery of another sk "1, the latter being "higher" in the 
learning hierarchy. It is also assumed that, because of this relation, 
mastery of the lower skill must transfer in some way to the learning of the 
higher skill. Both functional relations may hold in fact for learning certain 
ski 1 Is ; but it can be misleading to consider the relation defined by a 
necessary learning sequence, and that defined by vertical transfer, as a level 
or even a unitary relation. In fact, undue emphasis on a unitary relation may 
restrict the applicability of a hierarchy so conceived. As Bergan (1980) 
stressed, there can be a necessary sequence in learning without vertical 
transfer, and there can be vertical transfer without a necessary learning 
sequence. 

Hierarchical relations, especially in skill performance as opposed to 
learning, can. be defined in a number of ways; and if hierarchical models are 
to be useful for analyzing tasks and training requirements, it will be impor- 
tant to focus on the particular relations involved. Sch^a models of skill 
perfonnance posit a hierarchical structure of control that could be largely 
(but probably not completely) independent of learning sequence, and hence they 
open up possibilities for part-task training that might be excluded from a 
strict learning-sequence model. Schema models also imply lateral transfer 
that is in a direction reversed from the vertical transfer in Gagne's 
hierarchies. That is, higher "levels" of skills (analytic schema) mediate use 
of lower level skills (cue-response systems).^ (As lateral transfer, this con- 
ception ,1s not necessarily at odds with Gagne's.) With the definition given 
earlier, still other sorts of hierarchies can be conceived, embracing sequen- 
tial behavior, for example. If the performance of subtask A must precede sub- 
task B, and B precede C, etc., there Is an organizational relation Involving 
sequence. Design for training such a series of task elements should allow for 
the sequential restrictions (and probable sequential cueing) so as to minimize 
probl2ms of eventual task integration. From the standpoint of part- task 
training, a need for total-task Integrity during training of sequential skills 
may be quite different from that for sets of subtasks that have no strict 
sequential relations. 

In brief, it is necessary to recognize a number of defining relations for 
skill organization. In some instances, it may be helpful to view a model in 
terns of hierarchical organization whether or not the proponents of the model 
did so. (The reverse, of course, could also be true.) Also, sets, learning 
sets, and even feedback, exhibit relational characteristics that confonm to 
hierarchical organization. Fortunately, there are a number of techniques, 
rangi ng from psychophysical seal Ing to cluster analysis, for defining the 
bases of hierarchical organization In empirical terms. c> 
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SECTION, III- 
ANALYSIS OF COGNITIVE SKILLS 

As with any other phenomena, cognitive skills can be alyzed in a number 
of ways. The guiding principle in choosing a particular analytic scheme is 
therefore to seek relations among variables pursuant to a purpose. Sir Arthur 
Eddington's typically picturesque example of an elephant sliding down a grassy 
slope makes the point vividly. How wou,ld a physicist describe it in the 
language of his science, a language constructed specifically for his purposes? 
"A mass of two tons moving along a plane inclined at sixty degrees" is about 
all he can say. 

A serious problem in modern cognitive psychology is that there is at most 
a limited consensus regarding what is to be studied and hence an appropriate 
systematic language. In another picturesque example, Qlaxton (1980^) likened 
cognitive researchers to the inhabitants of thousands of little islands, 
representing different cultures, habits, and ways of talking about what they 
do. "Occasionally inhabitants of one island may spot their neighbors jumping 
up and down and issuing strange cries; but it makes no sense,' so they iqnore 
ir (p. 15). 

Many differences in research objectives and language, and hence con- 
structs, derive from metatheoretical^.preferences. There are neobehaviorists, 
neofunctionalists, neogestal tists, and neostructural ists. The first three of 
these groups have one thing in common, their metatheoretical differences not- 
withstanding. They concentrate on processes of cc ^itir \ r .se Or 
the other hand, neostructural approaches often ^if^ e in 

processes. 

An example i^^he short-term memory (SIM) versus short-term store iSTS) 
tenninology, or long-term memory (LTM) versus long-term store (ITS). As 
apparent later, STM and LTH can be defined operationally with no commitment 
regarding a fundamental distinction between the two. On the other hand, STS 
and LTS are hypothetical constructs that supposedly account for STM and LTM 
(Baddeley & Hitch, 1974). As with computers, "store" connotes a register— 
locus--that is integral to process. STS and LTS imply structurally distinct 
loci in the central nervous system; as causal agents, they supposedly engender 
memory processes that follow the different laws derivative of the loci. (Some 
writers refer to stores only metaphorically, however.) 

The present purpose in analyzing cognitive skills is to le^y a foundation 
for skill training, and especially for the design and use of part- task and 
low-fidelity devices. Training is a process and performance is a process. 
The former is to be designed so that variables, including equipment design, 
can be manipulated to develop the latter. A strict structural ^analysis, one 
that assumed the priority of memory stores, over processes, for example, would 
bt2f a roundabout way at best to reveal what can be done to change and develop 
performance. One would seek the characteristics of structures and their 
derivative laws. But to what purpose? Training* cannot change structures nor 
their immutable laws. 
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win be evident, strict structuralism, which seems to have peaked 
about ten years ago, Is on the wane. But even assuming concepts such as 
"store" to be valid, present purposes dictate an analysis of cognition in 
terms of processes. Further, the processes selected should be capable of 
manipulation for training. For example, a supposed characteristic of STM, as 
a process as well as store, is a severe liiriitation on the number of elements 
that ran be represented (remembered) at one time. Yet, there are numerous 
situations in which tUe limits are exceeded substantially. Theorists then 
speak of "chunking," or the combining of elements into chunks so that a chunk 
becomes an element, and the limits apply to the number of chunks A training 
developer needs to know how to cause chunks to fonm, and in a manner that 
optimizes training. If no guidance can be given, then chunking has no value 
as a training concept and hence should be Ignored in the present analysis. 

As explained later, chunking can be a useful training concept, but only 
if one goes well beyond discussions of the notion as such In research litera- 
ture. The choice of conceptual tools discussed in Section II was to provide 
for occasions such as this. Chunking can be manipulated through preparatory 
sets which draw on LTM, and trainees can learn to manipulate their own sets. 
("Set" may well be a useful tool for dealing with a number of STM processes, 
including control of interference--see later discussion.) 

Another example is the concept of schema, which in the abstract is the 
most useful explanatory construct in cognitive psychology. Schema-like pro- 
cesses govern all complex behavior, so developing appropriate schemata is a 
training goal of paramount importance. The trouble is, there is very little 
research on how schemata develop, let alone how to foster their growth. Most 
theorists who make major explanatory use of this concept live on one island, 
and those that talk of learning sets, for example, live on another. The pri- 
mary reason for including "learning set" as a conceptual tool (Section II was 
to gain a "handle" for the al 1- important concept of schemata. We know quite a 
bit about how to develop learning sets. 

The present analysis of cognitive skills, then. Is pursuant to i par- 
ticular purpose: a foundation for skill training in general and for designing 
and using part- task and low-fidelity training devices In particular. The task 
for the psychologist who would design training programs and equipment is to 
sift the strange cries emanating from the many islands for Insights into pro- 
cesses that can be manipulated for training. To do so requires an excursion 
into formal theories of cognition so as to clarify their concepts. Accord- 
ingly preceding the analysis of cognitive skills appear brief summaries of 
the emergence of-modern cognitive psychology, central concepts of infonmation 
orocessing, and a section illustrating theoretical approaches to memory. 
Cognitive skills are then analyzed in tenms of executive processes, short- tem 
processes, long-term processes, and motivation. 

EMERGENCE OF MODERN COGNITIVE PSYCHOLOGY 

Rega-dless of the degree of mechanization implied by a theoretical posi- 
tion "cognitive skill" connotes more than overt stimulus-response (S;'R) con- 
nections. There are medlational events between the occurrence of an Tnput ^ 
and the resulting output R that are Integral to the overall action. These 
events may be viewed as 1m"pHcit S-R chains (e.g., subvocal speech) as in the 
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classical behaviorism of Watson (1919, 1930) or Guthrie (1935); as constructs 
anchored to physical stimuli and overt responses as in the neobehaviorism of 
Hull (1943) or Spence (1956); or as organismic (0) mental and physiological 
processes as in the functionalism of Carr (1925) or the _S-£-^ formulation of 
Woodworth and Schlosberg (1954) • 

However, throughout this century there have been theorists insisting that 
the mediatlonal events are purely cognitive in nature and must be studied as 
such. That is, they are essentially mental--a physiological substratum 
notwithstanding--and they are manifestations of purposive, intelligent compre- 
hension of the situations in which actions occur. The cognitive point of view 
was systematized in the past by Tolman (1932) and the Gestalt school (Koffka, 
1935; Kohler, 1929/1947; Lewin, 1936), The cognitive theorists stressed that 
behaviorism, whether old or new, simply could not account for intelligent 
behavior. As it turned out, the cognitive theories of the first half of this 
century were not adequate for the job either (Hochberg, 1957; Miller, 
Galanter, & Pribram, 1960; see also Kohler, 1969, for discussion of fundamen- 
tal brai/n activities underlying thought that occur outside of mental activity 
per se) i 
/ 

Beginning around 1960 there was a renewed interest in cognitive processes 
that resulted in their study becoming part of the mainstream of current 
psychology. Rather than being only critics of the behaviorism that dominated 
psychology in this country from 1930 to 1950, cognitive theorists began 'to 
:*4s^play pentral roles in psychology's development. Some would date this 
renaissance to the publication of Miller, Galanter, and Pribram's (I960) 
Plans and the Structure of Behavior , a "subjective behaviorism" (Hil gard, 
1980) that would derive behavior from a hierarchical structure of plans. In 
the tjransitlon, a neostructuralism has developed (Mandler, 1962) • It has 
littlt in common with the structuralism of Wundt or Titchener, but it does 
rely jon an updated nineteenth century methodology: the use of reaction times 
to "track" and identify mental operations (cf. Castellan & Restle, 1978; 
Chasd, 1978; Estes. 1978b; Theios, 1973, 1977). Neostructuralism emerges when 
the Operations are ascribed to "locations" in memory- -working memory, short- 
term' store, long-term store, etc. (see Bower, 1975, for an elaborate flow 
diagram of the perceptual -memory system). 

Many writers eschew the structuralism, focusing instead on the mental 
operations as processes. And perhaps it is In this distinction, structure 
versus process (Estes, 1978^), that the most basic disagreements among today's 
cognitive theorists lie. "Process" theory appears to be an extension of 
neobehaviorism (e.g., Ker.dler & Kendler, 1975) or of functionalism (e.g.; 
Postman, 1975). These theorists, including the modern neobehaviori_sts, empha- 
size mediatlonal processes other than stimuli and responses; but they would 
conform to the approach of Woodworth and Schlosberg (1954) in having "a 
definite preference for objective aata but no taboo against material obtained 
through introspection if it helps the psychologist to understand what the 
organism Is doing in relation to the environment" (p. vii). Although it seems 
that neostructural ists would say the same thing, in practice they tend to go 
well beyond data, from readily inferred processes to mental agents whose 
relfications are Questionable. 

The structure-process distinction will arise several times in the 
discussions that follow. To avoid confusion, two different uses of "process" 
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should be clarified. One use 1s in the structural (i.e., structuralism) ver- 
sus process approach to cognition just mentioned. The other use of "process" 
as in "Information processing" Is generic. It Includes both structural and 
process approaches to cognition. The following discussion provides an 
overview of "Infonrietion processing" in its most general sense. 

OVERVIEW OF INFORMATION PROCESSING 

The use here of "information processing" (IP) departs somewhat from many 
current practices in that it includes even modern neobehavior istic conceptions 
of cognition. Although Estes (1978Jb) <ii stingui shed between "behavioral" and 
"Informational" modes of descriotions, he explained that either mode is "a 
confluence of metaphors and methods," a mixture of terms, concepts, and 
methodologies from both approaches (and others). The "new cognitive science" 
(Norman, 1981a, 1981Jb), wH^ch has taken shape in the Tast dozen years or so 
(Handler, 1977), appears to have drawn from most approaches, including even 
early functional ism, that view cognition as an intelligent interface of an 
organism with its environment. To react intelligently, an organism does not 
just receive a stimulus, it receives and processes information . As Estes 
(1975) pointed out, even conditioning "bears on the processes dnd mechanisms 
by which animals gain information about their environments" (p. 21). Thus, 
"we not only should but must be mul tidiscipl inary" in our study of cognition 
(Estes, 1975, p. 21). 

Our present shortcomings in the mul tidiscipl inary approach (see later 
discussion of long-- term processes) highlight the need to view IP in a broad 
sense. IP 1s no longer the prWince solely of "cognitionists" circa 
1960-1970. From whatever background and specialization, research is con- 
verging on how organisms receive, process, and respond to information from the 
environment. As a conception, IP thus encompasses sensation, perception, 
mediation, and response production. Any factor that affects one. or mpre of 
these processes is of concern, so research tactics range from examinations of 
physiological and neural functions to studies of sociological and ecological 
influences. While sociological and ecological Influences have been largely 
ionored in current cognitive theories, there *1s a movement to pick up where 
Kohler ( The Place of Value in a World of Facts , 1938) and Lewin ( A Dynamic 
Theory o^ersonallty , 1935) left off, f^re on this later. ' 

As a means of structuring later discussions of cognition ajid cognitive 
skills, it would be well to identify the stages and levels of IP as custom- 
arily defined. Adapted from Estes (1978b^, p. 11), Lachman, Lachmaii, and 
Butt.erfield (1979, ch. 4), and Simon (1978, p. 273), these str^^es and levels 
are (1) the registration of stimulus inputs in immediate sensory memory; (2) 
the coding of features of the stimulus Inputs in short-term memory (SIM); (3) 
the relating of contents of SIM to contents of long-term memory (LTM) by com- 
parisons with hierarchical networks of feature ensembles comprising the 
latter. Retrieval of information from SIM or LTM involves a search process, 
usually viewed as serial in nature, at least until recently. Processing 
during the interple^y of STM and LTM includes sequential comparisoiis of new 
inputs to LTM contents, with decisions depending on the matches or mismatches 
that are found. The matches and mismatches are, of course, determined by the 
purpose of the individual at the time. (4) After processing, a response is 
produced which will terminate the action if purposes have been achieved, or if 
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not, the response can be to seek new input or reprocess the old using a dif- 
ferent scheme or strategy. The response, of course, derives from past 
experience as represented In LTM, The contents of STM may of may not be 
assimilated into LTM at the end, depending-, it was once, believed, on how njuch 
It is rehearsed while in STM. 

As stated, IP will be considered In a broadseqse of the term; but this 
customary characterization Is a good pla^ to start an analysis of what IP 
Involves because most recent research addressed this characterization. 
Furthermore, the central concept is memory ; it is Involved In eVery phase from 
the registration of inputs in .immediate sensory memory to generating a 
response from LTM. This conception of memory differs radically from that In 
psychology prior to 1960. Memory 1s no longer sheer retention; It is also an 
agent that acts on and through sensory inputs. LTM, for example, not only 
contains (coded) static infonnation, but rules for^tions as well, including 
how to subject inputs and other contents of STM and LTM to transformations as 
they are' needed (to. adapt to different strategies in problem solving, for 
exampl el . ' 

Current views of memory often^follow closely the storage processes in 
computers arid how stored infonnation, including programs, operates on itself 
and on new inputs. In fact, many writers (e.g., Anderson & Bower, 1973, 1980; 
Bower, 1967; Lacnman et al . , 1979; Newell & Simon, 1972; Rumelhart & Norman, 
1975b^) developed conceptions^ of memory through deliberate analogies to 
computer operations, in some tases considering successful computer simulation 
of IP as conceived In humans a direct test of the validity of their theories. 
Others, though recognizing the heuristic value of the computer analogy, point 
to the dangers involved. Some of the dangers and those who have pointed them 
out will be identified in later discussions as they apply to particular 
Issues. Nevertheless, critical comments made later In this report notwith- 
standing, the computer analogy at least has provided models of memory that can 
account to some extent for the pervasive role of past experience In behavior. 
We have known for years, for example, that experience affects perception. We 
have observed that learning, motivation, and stimulus contexts Influence what 
Is perceived and how. But only recently have mechanisms, computer-like in 
nature, been conceived that describe how these Influences are brought to bear, 
specifically through memory actions . The computer analogy has also fostered 
the development of mathematical moaels of IP that have contributed mu^h to the 
analysis of separate processes and to the testing of conjectures regarding 
tnemu 

MODLLS OF MEMORY 

Depending on the theorist, memory Includes more, or fewer, stages and 
levels than were just identified as the core of IP. The variety of models 
presented in Mo dels of Hujnan ^te^ (Norman, 1970), for example. Illustrates 
the basis for Postman's (197^j) complaint, "the ratio of models to experiments 
Is quite high, although happily still less than unity" (p. 294). In 
accounting one way or another for almost every breakdown of memory and Its 
functions, Bower (1975) diagrammed relations among a score of components. The 
discussions thet follow provide perspective for memory models, and thereby the 
later analysis of cognitive skills, first through examples of general 
conceptions of metnorles, and then an examination of "dual-process" theory. 
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CONCEPTIONS OF MEMORY. After, describing his transition from a tr^^it onal . 

conception of memory as' mechanical associdtlonism to a "contextual view 
nr mrory Jenkins (1974) emphasized that "we should shun any notion that 
SLr? consists of a specific system that operates with one set of njles on 
re tinHf unn"°(p^ 793). As 'he described it. assoclatlonism ass^.es ther^ 



onekmo oT univ ^P- 'i.i-.7tir fa nature, and relations among them from 
Shich a^ memory is CO Js^^^^^^^^^^ On the other hand, contextual 1 sm assumes 
eSenJs IJe pTimary anS tha^ the qualities of events detemine what is remen-.- 
hPrpd and how The success of association-based fonnulas in predicting 
lZo% so Jenkins argued, had been due primarily to their derivation and use 
'^^°IL\^liTr...Lh. The fomulas could not be expected to .generalize 



in restricted contexts. The formulas 
across contexts. 

A Dosition such as this, which seems to have been well grounded by 1974, the 
^.^n^hlS DaDer raises several questions, but one is of particular concern: 
J f there p r a ^^ore^t of memory each with its own set o 

r^f*.nnd does 'the interplay of the different kinds vary with contexts? If 

and Bower ( 1973) and Atkinson and Shiffnn (1968). 

The Anderson and Bower model was essentially P'^ocess-oriented. External 

!^?on tn LTM which in turn outputs to the executive which also controls 

rtin'g^ res'ponfe"' Atkinson an5 Shiffrin^s (1968) ^,^"unt of t^^^^^^^^ 
cesses tended more to structural concepts: t^.^^^T^'^^^^'-'^s ?he 

for sensory processes, one for STM, and one for LTHT—Also. STM exercises the 

executive function. 

?Sruct Je^ thir^aj beTn]^ Phases of activation of a single memory 

structures, tney ""'J' ^ chiffrin (1977i combined the sensory and STM 

tSn'^'nd^c,"ter th'at 1nfo™et1on f™ sensor, -cep^rs can act v,te^_ pj 
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Nevertheless, there are still those (e.g., Glanzer, 1972, 1977) who maintain 
there are fundamental differences between STM and LTM that Imply more than 
temporally defined processes. That is, the differences imply separatee 
functional structures for STM and LTM (see below). 

Baddeley and Hitch (1974, 1977) proposed a working memory (WM) to replace STM 
in the STM-LTM dichotomy. WM is comprised of several subsystems not unlike 
those usually considered characteristic of STM. There is a difference, 
however, in that WM is conceived, as it was in the Anderson-Bower (1973, 1980) 
model, more in terms of functional than of structural properties. Functions, 
being dependent on task contexts, are less rigidly (but perhaps more vaguely] 
defined than structures. In this sense, WM is closer to the layman's concept 
of what one may "have in mind" at a given moment than is STM. The typical 
flow diagram in which information frm the senses must pass through STM to 
reach and activate LTM becomes meaningless (Hitch, 1980). A "central 
executive," a role served by STM in Atkinson and Shiffrin's (1971) system, is 
separate in the Baddeley-Hi tch model. It also has direct access to LTM and 
can thus activate LTM without "going through" WM. 

Although Baddeley and Hitch (1974) said their system was "in the spirit" of 
models such as that of Atkinson and Shiffrin (1968, 1971), the fomer also 
reflects an essentially functional concept of structure as defined byMandler 
(1962): "Structures are temporal and probabilistic linkages of inputs and 
behavior which are available in functional units" (p, 415; all italicized in 
the original). Accordingly, WM is defined not by cn enduring structure, or 
even characteristics of its contents, but by its mechanisms Involved in per- 
ceptual and linguistic coding and organization, transfer of information to 
LTM, etc. 

Mandler (1967) expanded on the nature of the linkages that provide functional 
units. In this model, clusters of elements (words, names of objects or ani- 
mals, etc.) form hierarchical relations with each other in "permanent vocab- 
ulary storage''^ (he circumvented the STM-LTW issue). His central hypothesis, 
which has quite a bit of confirmation (Mandler, 1967, 1977), was that encoding 
of inputs, and their recall, tend to follow the hierarchical clustering in 
permanent vocabulary storage. Furthermore, separate clusters and their 
supraordinate-subordinate relations with each other develop with experience. 

Mandler' s model, as do most memory models, addressed primarily data from stan- 
dard experiments in verbal learning. It is of particular interest here 
nevertheless, and for two reasons. First, the conception that immediate 
recall of inputs has the functional structure of hierarchical clusters in LTM 
(not Mandler' s term), and the evidence supporting this hypothesis, may provide 
an empirical "handle" on the patently circular concept of "chunking" (see 
Dual-Process Theory below). Second, the conception can also help clarify the 
nature of learning hierarchies in theories such as that of Gagne (1962, 1965, 
1968). The systems are not completely compatible; but dynamic characteristics 
that might be ascribed to Mandler's hierarchical jilusters in LTM are similar 
to the roles of learning sets as conceived by Gagne. The similarity opens up 
at least the possibility that an empirical handle can also be available for 
assessing the nature of long-tenm strategies and habits, now called "learning 
styles," individual learners bring to a training situation. If so, something 
more than pencil -and-paper tests and job samples can be used to assess the 
beginning characteristics of students and to individualize their instruction. 
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Instead of relying solely on status measures, some Insight can be gained into 
the dynamics of how they learn various skills. 

Dynamic properties of memory processes are central to the system of Nonnan and 
Rumelhart (Norman & Rumelhart, 1970; Rumelhart & Nonnan, 1975a^, 1975b). 
Extending a point from Bower (1967), vector notations identify the content and 
direction of processes in a dynamic memory network. The network is charac- 
terized by schemata (Nonnan & Rumelhart, 1975) which are simultaneously 
discriminative and generalization systems. The schemata underlie analogical 
thinking and are thus systems of transfer. (The significance of this point 
for instruction is treated briefly by Nonnan, Gentner, and Stevens [1976], and 
at length by Rumelhart and Nonnan [1981].) 

One more type of conception can be added to the foregoing illustrations of 
cognitive models, one that has particular value for instruction. The focus is 
on "metacogni tion" and "metamemory which are -new terms for some fairly old 
ideas (see Fl a/ell & Wellman, 1977, for earlier thinking on metamemory and 
review of rela .ed research). For example, metacogni tion, which includes meta- 
memory, encompasses what one is to profit from in acquiring study skills; but 
modern analyses of the concept go far beyond the puerile guides found in "how 
to study" manuals. Metacogni tion incorporates essentially all the processes 
ascribed to the executive role in modern models of cognition: recognition of 
the problems at hand in terms of one*s purposes; analysis of salient features; 
"awareness" of the repertoire of available analogical schemata and their 
domains; planning strategies and scheduling and implementing them; monitoring, 
evaluating, and regulating actions; etc, (Brown, 1978). 

Formalization of the conception as "metamemory" has focused some research on 
processing variables that have been mostly ignored in formal models of memory 
(but not necessarily in models of problem solving and understanding). Models 
of memory have stressed characteristics and processes of STM, WM, LTM, etc., 
not the executive" or "central processor." In doiny so, they have missed the 
distinction, critical to real-world perfonnance, between knowing "what" and 
knowing ''how." In an experiment on verbal recall, a subject\need know only 
what. Knowing how is requisite to problem solving, not how as mechanized pro- 
cedures per se, but how as schemata for selecting and adapting pV^ocedures, for 
acquiring needed information (Brown, 1978). Many problems faced by mainte- 
nance technicians could be readily resolved if they could recognise what they 
do not know that they need to know and where and how to obtain the infor- 
mation. Even leading models of problem solving (e.g., Newell & Simon, 1972) 
are no help to one who must design an instructional program for maintenance 
personnel. The models assume that the problem solver has the requisite infor- 
mation formulated in appropriate form, such as could be entered as data and 
programs in a computer. What is needed is a computer program that can solve 
the pendul um problem. The computer must be surprised at the problem 

^In the pendulum problem, the subject* s task is to tie together the ends 
of two strings that are suspended from the ceiling, but too far apart for both 
to be reached at the same time. The only solution is to tie an object such as 
a pair of pliers to the end of one, swing it, and grasp it on the return while 
holding the end of the other string. How must a computer classify a pair of 
pliers? It would have to see it as a mass, not a tool for grasping, and then 
intuitively relate pi 1ers-as-mass to gravitational forces acting on a 
pendulum. See Duncan (1959) for a review of traditional research on problems 
of this sort. 
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requirements In view of what is given, and respond creatively to arrive at the 
solution.-^ Creativity is implied because simply having the necessary 
information is not sufficient ( cf , Duncan, 1959, p. 406). 

Existing computer models are notoriously noncreative in this sense (Bower, 
1978). ^Xfvey are not limited so in principle, but because of the complexities 
of^prtigramming involved, computer models in the immediate future are not 
likely to help train a person who must suddenly adapt to unexpected, novel 
emergencies or to' unanticipated problems with equipment. What N. R. F. 
Maier,2 for example, studied over the years seems much more pertinent for 
identifying what trainees need to learn to do and how to teach them. 

This discussion has no more than scratched the surface of conceptions of 
memory, both in terms of the number of models that have been proposed and in 
the depth of those discussed. It will be sufficient for present purposes, 
however, if it provides a suitable context for discussing dual-process theory, 
and together with that discussion, a context for examining processes of 
cognition that can be expected to have instructional significance. 

DUAL -PROCESS THEORY. In his review of research on verbal learning and memory, 
Postman (1975) titled one major section "The Short and Happy Reign of 
Dual-Process Theory." He was referring specifically to the STM-LTM dichotomy 
when viewed either as two distinct processes or structures. However, as was 
the case once with Mark Twain, announcement of the demise vas perhaps prema- 
ture. Later analyses of cognitive skills take a definite stand regarding this 
^^dichotomy. The following discussion gives a basis for the stand. 

What is the evidence for two distinct processes? The most often cited evi- 
dence is that which led to Miller's (1956) "seven plus or minus two" paper. 
Miller's point was that the immediate assimilation of sensory inputs, visual 
or verbal, is restricted tc only a few elements (i.e., seven plus or minus 
two). Such limits, frequently no nifore than five or even fewer elements (cf. 
Glanzer, 1972; Handler, 1967), characterize Immediate free recall after~a 
single exposure to, say, a list of unrelated words or digits. Some consider 
these limits inviolable. In the Atkinson-Shif frin model, once all slots have 
been filled, an additional input can be accommodated only if it bumps out one 
of the present elements (Bower, 1975). LTM has no such limitations; it is 
essentially unlimited. Hence, the reasoning sometimes goes, there must be 
immediate, short-term memory processes that are distinct from those of LTM. 

Obviously, immediate memory often encompasses many more than five or even nine 
elements. "Chunking" is inferred to account for the increase. That is, 
elements become organized into chunks accordi ng to, for exampl e, their 
interrelations. While one may have immediate recall for only seven or so 
unrelated words, a sentence of many more words may be recalled easily. The 



Requirements here are for flexibility in sets with which problems are 
approached, and in overcoming "functional fixedness" (restrictive sets). See 
Greeno, Magone, and Chaiklin (1979). 

Tor a sampling of the scope and depth of Maier's work, see Maier, 1930, 
1931, 1945, 1960; Maier A Burke, 1966, 1967. 
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limits for. immediate assimilation then apply to the number of separate chunks, 
not separate elements. Total immediate memory (STM) is thus determined by the 
size of the chunks that are immediately formed. Bower (1975) forthrightly 
points out the circularity of chunking so conceived. (As mentioned earlier, 
evidence for Handler's [1967] hypothesis regarding similar clustering in STM 
and LTM may provide an empirical handle for chunks, removing the circularity.) 

It is difficult to see how anyone could consider me'nory span per se grounds 
for insisting on a dichotomy between STM and LTM processes or structures. An 
important training issue is raised later in this regard. However, for the 
present, an example involving memory for digits will suffice. It is well 
known that when presented the problem on an intelligence test, subjects of 
normal intelligence can recall only seven or so digits when pronounced, 
without emphasis, one second apart. Individual intelligence tests from 
Terman's to Wechsler's have incorporated such items. Yet, Chase and 
Ericsson's (1981) subjects, originally able to recall only seven digits so 
presented, after two years of practice could recall more than eighty . 
Nevertheless, there appeared to be more evidence for two processes than that 
provided by memory spans. For example, it seemed at one time that STM coding 
involved only phonemic processes with no semantic coding. That is, encoding 
of sensory inputs in STM was achieved solely through symbolic, linguistic 
"tabs" that served only to index the material in STM. On the other hand, LTM 
depended predominantly if not exclusively on semantic processes through which 
relations, organizations, and reorganizations of LTM contents acquired 
linguistic structure. Later, on the basis of their and others' work, Craik 
and Lockhart (1972) held that information in STM was probably In visual and 
possibly in semantic formats as well as phonemic. (Recall earlier mention of 
Shiffrin's [1977] subsuming the sensory register under STM because of 
recoding.) Shulman (1971) went even further. After reviewing a large number 
of studies, he concluded that semantic encoding in STM had been clearly 
demonstrated; the trouble in finding it had been that it did not occur unless 
the experimental memory task required it. There Is also considerable evidence 
that some contents of LTM are images, that they are not entirely semantic. In 
fact, forty years ago introductory psychology texts stressed that children 
remembered in images because they had not yet developed verbal facility. A 
later discussion of imagery will return to this issue. 

This takes care of only two presumed differences betwev<^n STM and LTM, however. 
Wickelgren (1973) , while concluding from his review that most evidence 
allegedly supporting a STM-LTM dichotomy was equally consistent with a single- 
system model, believed that three phenomena supported only the dual-process 
model: (1) retention functions have different forms for STM and LTM; (2) STM 
is affected by interference from "gross" similarity effects, but not subtle or 
"fine-grained" similarities as is LTM; and (3) some findings with brain 
damaged subjects such as specificity of memory deficits are easie»^ to 
interpret within dual-process the'>ry. However, Wickelgren later (1980) 
equated STM to "active memory," and the latter to attention span. Active 
memory Is an activated subset of "passive" memory. I.e., LTM, from which 
various memory traces can be in different degrees of activation. 

Other possible differences between STM and LTM have been reported. Though he 
took issue with the supposed implications. Postman (1975) listed encoding 
variations related to how long material must be retained prior to a test of 
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retention; effects of modality of presentation on perfonnance; and inter- 
actions of serial position of verbal materials to be learned with various 
experimental conditions. Glanzer (1977) cited others' findings which he (but 
not necessarily the original investigators) held to support dual memory 
processes: differences in imageabllity of words (Richardson, 1974); effects 
of spacing practice and rehearsal on recall (Pollatsek & Bettencourt, 1976); 
the effect of articulatory suppression on free recall (Richardson & Baddeley, 
1975); changes with practice in primacy and recency effects on free recall 
(Goodwin, 1976); and the effects of prior recall upon subsequent recall 
(Gardiner & Klee, 1976). Glanzer did not explain how the findings of these 
studies support the STM-LTM dichotomy, and in some cases the supposed support 
is clearly questionable. 

Various writers have rebutted each of these points with arguments ranging frorri 
counter-examples to rejection of certain findings as being irrelevant. We 
need not pursue the specific issues; when needed, they will be clarified as 
functional characteristics ascribed to STM and LTM are discussed. There Is 
one alternative explanation for ostensible unique STM characteristics that 
should be mentioned, however. It has significance for training and the writer 
has found no prior systematic treatment of the point. The p^oint is explained 
in what follows. 

Many if not all properties alleged to be unique to STM have been observed in 
the past to be manlpulatable through sets that necessarily depend on LTM. 
Sets explain why STM can be accessed so quickly. The relation of sets to 
chunking is apparent in many mnemonic devices, especially those In popularized 
accounts of "how to improve your memory." Sets play various roles In sensory 
and perceptual processing, an STM function (Haber, 1966). More subtle, and 
much more complicated, is the relation of sets to interference and facilita- 
tive phenomena. Interference phenomena especially are thought by several 
writers to be different, In some cases nonexistent, in STM. 

Under at least, some common conditions, interference can be readily manipulated 
through task sets. For example, Jenkins and Postman . (1949) found that 
similarity-dissimilarity of sets in original learning (OL) and Interpolated 
activity (lA) had effects on rectill of the original learning comparable to 
those of similar and dissimilar materials to be learned. That is, if OL and 
lA involved similar sets, retroactive inhibition occurred just as it does for 
similar OL and lA stimuli; if lA involved a different set, however, retro- 
active inhibition was considerably reduced (or did not occur at all) just as 
would be expected with dissimilar OL and lA tasks. Furthermore, Jenkins and 
Postman (1949) reported that when a change in sets was induced during OL there 
was an adverse effect on retention. 

Sets in the Jenkins-Postman study were induced through perfonnance of the 
tasks themselves. Earlier, Postman and Jenkins (1948) reported effects on 
retention when sets were induced by verbal instructions. In this case, 
instructions on how to proceed with the learning task and retention test had 
to be comparable to avoid interference. 

These results, which are quite consistent with those of similar studies (e.g, 
Nagge, 1935; Postman i Postman, 1948; Underwood, 1957), illustrate the 
complexity of the relation of sets to interference, which is usually observed 
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with no thought of how experimental procedures induce interfering sets even as 
the experiment progresses (Underwood, 1972). As just mentioned, a change in 
sets during learning can introduce Interference (Jenkins & Postman, 1949). In 
typical short-tennn retention studies, sets induced by the experimental proce- 
dures or by the subjects themselves may well account for peculiarities of STM 
interference processes. If so, there are obvious training implications, and 
i t woul d certainly be worth the time to expend part of our efforts in 
exploring the effects of sets on STM-like phenomena systematically. It was 
widely believed, at least until the last couple of years, that infonmation in 
STM had severe time limits unless constantly rehearsed, that when used the 
information had to be processed serially, etc. (see later discussion of STM 
processes). It would take us too far afield in this paper to show how counter 
examples can be, and have b^n, generated through manipulations of sets. But 
again, a thorough exploration of the roles of sets should show how STM-like 
phenomena can be manipulated to enhance permanent learning and performance. 
With present conceptii ns, there is little to do with some STM phenomena except 
point at them. 

Sucli an effort will require careful logical analyses. As might be expected, 
phenomena as ubiquitous as sets are not simple. Gibson (1941) discerned some 
40 different operational uses of the term in experimental psychology. As 
Humphrey (1951/1963) pointed out, the number would be increased if the dif- 
ferent uses of Einstellung in work by the Wurzburg group in Germany were 
Included; and the number would be even larger if the causal attributes of sets 
in modern models of cognitive and motor performance were added. 

On the other hand, the conception of hierarchical learning sets provides a 
powerful analytic tool for ordering the many manifestations of transitory 
sets, for that is what learning sets are all about. 

Before leaving dual-process theory, a common criticism of the theory should be 
mentioned. The criticism, which appears in a variety of forms, is that the 
STM-LTM dichotomy leads to an unnecessary reification of memory structures, 
and 1s . thus an undesirable violation of the law of parsimony. One of 
Glanzer's (1977) responses to his critics illustrates the point. Commenting 
that general objections derive from a preference for a single-process theory, 
he stated, "when explicit theories have been presented as general single-store 
theories, they have always turned out to nt*ve two elements: two rehearsal 
processes, two decay processes. Their difference from multiple-store theories 
becomes difficult to determine" (p. 121). In other words, two rehearsal -decay 
processes imply two agents (stores) to govern them. 

Objections to reification of causal agents are based on more thdn an arbitrary 
preference regarding formulation*: of scientific statements. There is a danger 
of posing meaningless questions for research--what Planck (1949) called phan- 
tom problems--resul ting in misguided efforts and useless results. Once the 
ether was reified, physicists sought its mechanical properties. We research a 
topic the way we talk about it (Spears, 1960). As Postman (1975) stated, 
"Once STS [i.e., STM as a "store"] was proposed, its capacity, the charac- 
teristics of the units held in it and displaced from it, and its temporal 
parameters had to be specified" (p. 308). Only a brief review of research in 
this area reveals a considerable effort to do just that, to determine the form 
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of a hypothetical entity. 1 As a result, "cognitive psychology has been 
surprisingly little concerned with learning that changes process and capacity, 
focussing instead on the demonstration of processes and structures that are 
supposed to remain unaltered by the experiment, or on learning in the sense of 
acquiring new knowledge that changes content (you 'know' more) but not process 
(you cannot 'do' more)" (Claxton, 1980b, p. 9; emphasis in the original). As 
win be apparent later, "knowing" implTes "doing" in much of cognitive theory, 
but there is still something missing. For the ramifications of the restricted 
research focus, including social implications, see various articles in Claxton 
{1980a) and Norman (1981a), especially those by Claxton (1980b, 1980c), Curran 
(1980), and Norman (198l¥, 1981^). The critical self-apprais"?) represented in 
these volumes had predecessors, of course (e.g., Estes, 1975, 1978b), but 
perhaps the number of articles in these volumes addressing the restricflveness 
of cognitive research herald a broader outlook for cogniti_ve science in the 
near future. It must at least have the outlook implied by the above quotation 
from Claxton if it is to undergird in a systematic way a theory of instruction 
as envisioned by Glaser (1982). 

SKILL LEARNING, PROBLEM SOLVING, AND EXECUTIVE PROCESSES 

A cognitive skill involves cognitive tasks. In and of themselves, the 
tasks may or may not involve a problem in the sense this term is used in 
experimental studies of problem solving. That is, the tasks may be performed 
more or less routinely, even algorithmlcally, requiring no particular effort 
of a mental or creative nature. 

Even so, novices usually have not yet learned to perform mechanically, to 
adapt routine operations automatically to peculiarities of varying situations, 
or even to recognize that given tasks are called for. To them, learning the 
tasks, the adaptations, the indications of need, involves efforts' not unlike 
those required when presented with a true problem. Moreover, the task may 
appear m-structured in that the trainees do not have component skills and 
knowledge necessary to solve the "problem." They must learn to formulate 
goals and purposes for the systems they work with and for themselves in rela- 
tion to the systems. They must learn to assess the situation in tems of the 
goals and purposes, and of the contextual factors characterizing particular 
situations. They must also learn to identify pertinent information imme- 
diately available, to cietermine its adequacy, and to acquire additional 
information as needed. 

To deal with the occasion, trainees must develop a suitable set of action 
alternatives and learn to choose among them. They must become able to eval- 
uate outcomes of their actions and to discriminate between outcomes that 
clearly fulfill the purpose and those that do so only partially or not at all. 
As indications warrant, they must alter or change attacks until purposes are 
clearly fulfilled. Finally, they should be able to repeat the whole process, 
but with diminishing effort, when similar occasions arise in the future. 



"Form" here refers to the Aristotelian concept of formal cause. Form is 
essence, and effective cause is derived therefrom. See Spears and Deese 
(1973). 
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That these steps have analogs in problem solving is evident from both 
traditional and modern studies of the process. The primary difference is that 
instead of having the necessary resources at the outset, the trainee must 
acquire tFiem. But this too has an analog in problem solving: problem solvers 
often have to learn the strategies needed (Greeno, 1978£, 1978b). 

The analogy between learni ng routine tasks and problem solving can be 
pushed too far. However, it is of no serious consequence if it is exag- 
gerated. And there is much to gain from the analogy. Problem solving has 
been studied throughout this century, and modern cognitive approaches to the 
topic have shed light on classical issues. The acquisition of cognitive 
skills has hardly been studied at alK The analogy between problem solving 
and learning the tasks involved in cognitive skills thus pennits extrapolation 
of research concerning the former to guide training of the latter. At least, 
the cognitive factors requisite to and involved in problem solving identify 
the kinds of knowledge one must have for intelligent perfonnance of skills. 
How close the analogy can be is evident in the discussions below of five exec- 
utive processes involved in problem solving and in cognitive behavior 
generally. They are called "executive" because they are the operations 
ascribed to an executive or central processor in models of cognition. 

RECOGNITION OF A PROBLEM. Task analyses typically stipulate that on a given 
cue a task is to be initiated and implemented. Accordingly, training focuses 
on cue recognition, interpretation, and ensuing decisions and actions. In a 
Thorndikian mode, training involves presenting the cues and providing feedback 
for decisions and actions, giving guidance as required. A cognitive approach 
emphasizes tt)9, internal processes of cueing, decision-making, and the 
selection, initiation, and implementation of actions. 

Cueing in the sense of the onset of a situation requiring action is the domain 
of "proulen" (i.e., task) recognition, or the realization that the situation 
requires that something in particular be done. A trainee is to learn to ana- 
lyze the situation so as to key on its pertinent aspects. In this sense, 
recognition implies discrimination of facets of situations that vary with con- 
texts and with immediate as well as long-range goals. In other words, 
trainees need to acquire means for structuring situations according to pur- 
poses, and the means should be flexible enough to encompass the variety of 
situations in which performance must occur (skill robustness). 

Standard operating procedures (SOP), inaintenance schedules, etc., in the anmed 
services attempt to provide comprehensive structures for task perfonnance 
whereby occasions for actions and the nature of the actions are specified. 
Skilled personnel must go beyond formal instructions of this sort, however. 
For example, they regularly encounter si tuations--"il 1-structured" problems as 
they are called in research 1 1 terature--that should be recognized, analyzed, 
and dealt with in the absence of standard Instructions. As Simon and Hayes 
(1976) put it, a leaking faucet says, "fix me." A drip of oil, inconsistent 
equipment operations, unlikely readings on a test stand, too frequent 
breakdowns--a host of everyday Incidents comprise cues that never get listed 
in task analyses; nor can all of them be anticipated and included in training. 

The training problem is to develop expectancies for what should happen that 
not only conform to routine operations but which are sensitive to deviations. 
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That is, persons responsible for, say, operating a piece equipment should 
experience a feeling akin to cognitive dissonance when something out-of-line 
happens. 

This use of "cognitive dissonance" is rather mundane compared to the explant.- 
tory power ascribed to the concept by Festinger (1957). It refers to the same 
phenomena, however: motivational states requiring resolutions cf deviations 
of events from expectations. This is not the place to explore the motiva- 
tional implications for training, but as explained later, they are not triv- 
ial. According to Tuddenham (1966), "disequilibrium," a concept very similar 
to cognitive dissonance, is the central concept in Piaget's theory of 
motivation: one's understanding of an occasion is in disequilibrium if 
adaptation to the 'occasion is not complete, and behavior pursues equilibrium. 

Recognition of a problem (read "of conditions calling for a particular task") 
should Involve a comprehension, a schema, that will be in diseo.^11 ibrium until 
i ssues givi ng r1 se to task performance are clearly resol vec ( see Feather, 
1971, for discussion of this point 1n relation to cognitive structures). For 
problems such as the leaking faucet, such a schema requires a fairly ful 1 
understanding not only of routine task requirements, but of the situation and 
any equipment employed. In the past several years, military training has come 
to emphasize "need to know" as a criterion for theoretical portions of 
syllabi. In turn, "need to know" has been viewed largely in terms of cogni- 
tive requirements for manual operations and for responding to feedback. 
Probably not every operator, but at least a closely attending supervisor, 
should have an understanding of principles of, say, equipment functioning that 
goes beyond everyday operational requirements. 

Given requisite understanding, schemata sensitive to disequilibrium or disso- 
nance require perceptual and other cognitive processing of infonnation that is 
usually ascribed to STM and LTM functions, for example, recognition of 
patterns of sensory inputs and of matches or mismatches of coded inputs with 
patterns in LTM. These and related processes are discussed later. It can be 
pointed out now, however, that the training issues just raised are a new 
twist. Theories of cognitive performance stress the recognition of a target 
pattern or a match as the determiner of action ( cf . Juola, 1979). If a , pat- 
tern or match is not obtained, the subject searches memory, transforms inputs, 
tries new schemes, etc., until it is. The point here is that patterns not in 
LTM, or mismatches, can be significant cues themselves, and training should 
target such cueing. 

COMPREHENSION OF THE TASK. Greeno (1977, 1978a. 1978b) has focused on the 
role of understanding in problem solving and instructional Issues related to 
the role (Greeno, 1976; Anderson, Greeno, Kline, & Neves, 1981). (This is not 
to say that understanding has been slighted by others; rather, that Greeno has 
chosen to deal systematically with processes of understanding where many 
others brought them in ad hoc or sometimes assumed them.) He presented 
(Greeno, 1977, 1978^) three criteria of understanding or evaluating solutions 
to problems that apply with minimum adaptation to what is involved in 
comprehending a task. A brief discussion of the criteria will show the 
relationship. 

Coherence . Does the pattern of cognitive relations among components comprise 
a compact structure? If the relations are poorly integrated, tHere is a lack 
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of understanding of the problem solution. Citing Duncker's (1945) distinction 
between organic proofs and mechanical proofs In geometry, Greeno pointed out 
that organic proofs, which depend on higher-order relations among steps, are 
evidence of more understanding than is shown by a mechanical progress from 
step to step with attention focused only on the justification of each step in 
isolation. Comprehension of higher order relations Involves not only knowing 
what steps, but wh^ steps are to be taken. 

Similarly, one can say that an organic knowledge of a skill represents a 
higher level of understanding than does only a mechanical step-by-step 
knowledge. Organic knowledge Implies comprehension of the interrelations of 
tasks comprising the skill (and of tho equipment, etc., employed) while a 
mechanical knowledge might not go beyond a sequential procedure for performing 
the separate tasks in series. There is no question which level of under- 
standing is necessary for flexibility in skill performance as just discussed. 
Yet some military training groups specifically object to going beyond gross 
mechanical levels. 

Cognitive integration of tasks Is a concern in the design of part-task 
trainers- However, unlike some motor skills that require v^oordi nation of 
motor dynamics, cognitive skills can be Integrated cognitively. As for low- 
fidelity devices, the integration of purely cognitive skills such as proce- 
dures requiring already thorJiighly mastered motor actions can be ^taught with 
crude mock-ups so long as the learners have clear pictures of how symbolic 
actions become overtly manifest in real situations. 

Co rrespondence . Does the cognitive representation of a problem have the same 
structural properties as the problem? As Greeno (1977) pointed out, this cri- 
terion has subtle aspects. Fov* example--and here we switch at once from 
problem solving to task performance generally--1t is one thing for an 
understanding of a skill to correspond directly to the objective aspects of 
the constituent tasks and the situation for performance. It is another th':ng 
to transform the cognitive representation of the situation so as to recon- 
struct task patterns that correspond in a different way, thereby obtaining a 
more effective approach to fulTflling the purpose. (These transformations are 
the essence of skill robustness.) Creative troubleshooting often calls for 
transformations in order to adapt testing and confirmation procedures. As 
with coherence, adaptations require comprehension of the situation as a 
whole--a causal structure for troubleshooting (de Kleer & Brown, 1981)--so 
that transformed cognitive representations still focus on the purpose and 
variables essential to its fulfillment. 

Connection with Other Knowledge . Is the cognitive structure representing a 
problem or task connected to other knowledge in a person's repertoire? As a 
criterion for understanding in problem solving, "connectedness", may mean only 
that a subsequent similar problem can be solved more readily after a solution 
is found to the first one. At a higher level, the original problem solution 
is related to a general principle that may or may not have been already known. 
For task performance In general » the first level corresponds to what was 
termed in Section II "near*' or "specific" transfer, while the second level, 
involving general principles, is the basis for "far" or "nonspecific' 
transfer. In either case, task comprehension would go beyond si tuational .y 
bound, stereotyped cognitive representations of performance. 
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PLANNING PERFORMANCE. To the extent a skill requires more then mechanical 
^repetition of habitual operations, effective, efficient performance requires a 
plan. (A .novice, of course, must plan actions that only later will become 
habitual.) A schefna or plan for performance is needed, one With enough flexi- 
bility to adapt *to the nonroutine aspects of the occasion. The perfomer 
should recognize contingencies beforehand and have criteria for decisions the 
contingencies entail. Through its own organization, the schema should provide 
an organization for the tasks to be performed. For creative adaptations of 
skills as in nonroutine troubleshooting^ th^ schema would have to be capable 
of analogical application.} That is, it would be necessary to transfonm the 
cognitive representation of the task, or the schema itself, so as to establish 
the necessary correspondence between them (see preceding discussion of 
Correspondence) . 

An important part of any performance p'ian is a set of subgoals. These are 
intermediate objectives that can lead directly to completion of the task, or 
depending on outcomes when subgoals are achieved, they can be points at which 
progress is evaluated and decisions are made as to the next step. Reed (1977) 
explained the facilitative value of subgoals in problem solving; they are just 
as important in any task performance. Troubleshooting, of \COurse, usually 
involves a hierarchy of subgoals (tests) whose outcomes are 'bases foj^-deoi- 
sions regarding the next task ( and ^subgoal ) . In a sense, even sequential 
routine tasks comprise a sequence of subgoals: Task B is to be initiated on 
the completion of Task A; Task C is then to follow Task B; etc. 

From a training standpoint, it is not trivial to call routine tasks comprising 
a procedural sequence "subgoals." In fact, one major difference between 
experts and novices is that novices lack processes for establishing and 
handling subgoals {Jeffries, Turner, Poison, & Atwood, 1981). The problem is 
to teach trainees to comprehend the task organization and then use task 
completion and related feedback as discriminative cues for the next task. 
Learning this sequence of subgoalS'^and how to evaluate their achievement is a 
critical cognitive requirement. Trainees are to incorporate the subgoals into 
their plans for practice, and at first the incorporation usually hc|s to be 
deliberate. As training progresses, sequential cueing of this natur^ may be 
taken for granted except when generalization of skill performance tojvarying 
circumstances is practiced. . J 

A number of skills, controlling the flight of an airtraft, for example, are 
regularly performed in varying situations. These s'kills rarely become so 
mechanized that deliberate planning of subgoals can be entirely omitted. 
Desired instrument readings change with maneuvers and flight conditions; 
checkpoints vary with the terrain navigated; etc. Versatility in planning, 
based on an understanding of the interrelations of numerous factors, can be an 
everyday requirement. 

INITIATING, MONITORING, AND REGULATING PERFORMANCE^ The first of these, ini- 
tiating performance or response production, is an enigma to anyone wno seeks 
an explanation in terms of mechanisms (see also the discussion of this topic 
in Section IV). Except for the reflex arc--a neuro-motor conceptions- 
traditional associat Jonism circumvented the problem more or less axiomati- 
cal ly: a response occurs in the presence of a stimul us wi th which it is 
associated. Unless, of course,- it doesn't, in which case we resort to habit 
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hierarchies and probability statements of the axiom. It is diffie-uU to see 
that modern cognitive psychology* helps much in explaining the mechanisms of 
response^ production. In a sense, responses become integral to the matrix of 
Components and processes of cognitive structures. Their selection derives 
from hierarchical determiners <leveloped during infonnation processing. Once 
select«»d, responses just happen. The effective caus"e is the structure of the 
cognitive matrix per se. (Recall that in 'Section II "cue" was defined to 
Include cssociated responses.) For some insightful analyses of this problem, 
see Allport (1980£, 1980b^) and Harvey ana ^reer (1980). 

Perhaps a desire to identify a mechanistti of response production is 
unrealistic, or even irrelevant. At any rate, the mechanism is likely not a 
part of cognition as such; rather, it 4s one of the aspects of brain 
functioning that Kohler (196?)' considered "outside" mental activity. '1 The 
Intuitive cogency of the cogtiitive matrix as effective cause of responses 
derives from an emphasis on verbal learning and perceptual processes that are 
encoded linguistically. If a subject is to recall words, and their represen- 
tation in LTM is semantic, then verbal recall--the response of interest—is 
ipso facto a manifestation of the contents of the matrix. Why worry about the 
larynx and other motor mechanisms of speech production? , 

This view can go a long way. There is little doubt that memory even of motor 
skills depends heavily on linguistic processes, especially semantic organiza- 
tion. In performing a procedural skill involving a sequence of separate 
tasks, for exairiple, operators talk to themselves in some fashion. 
Verbalizations comprise cueing systefr.s, and the problem of response production 
is no more (on less!) than it is in a conditioned reflex. 

But is a linguistically based causal matrix adequate? It is difficult to see 
h w many if not most aspects of complex motor skills can be brought under a 
linguistic umbrella. Only after mastering the mechanisms of speech can on& 
ignore muscle control of speech production. The trainee trying to learn a 
moto'" skill has much more in common with a young child struggling for breath- 
larynx control than with a subject in a verbal learning experiment. LiM must 
provide for retention of component .organizations that are not semantical ly 
organized. Nonverbal acoustic memory (Nelson & RothbartT~l972) is one 
example, and Shepard and Podgorny U978) reviewed evidence that LTM includes 
some visual com^^onents with clearly cognitive functions. It seems that the 
assumption should be that LTM necessarily Includes a host of perceptual com- 
^punetits, especially those corresponding to proprioceptive experiences. If 
not there must be more than one system for long-term retention and more than 
one'processing systetri, one set for verbal coding and one for general experien- 
tial coding. There are good reasons for rejecting such an inference (Claxton, 
1980c). (As apparent in Section IV, models of motor performance do not 
clarTfy this issue. In fact, the inclination of researchers seems to be that 



^Kohler went turtlier than this. He apparently would have considered many 
of the mental phenomena bf primacy concern in modern cognitive research to be 
epiphenomena-a disturbing ^ pos5,1b11 ity in view of current dependence on 
"mi-ospection for data and analyses. '(Bower [1978], Evans [1980], and Nisbett 
and Wilson [1977], made a related :p(0 int.) In, trying to resolve the Impasse, 
Kohler earl lerjy 1959) called not on 'introspect! ve,'a)ut beh^j^oral methodology. 
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once perforniance of a SKi'll becomes habitual, It is no longer of theoretical' 
interest [All port, 1980^; Kinsbourne, 1981].) 

It is also less than obvious that production of actions in many procedural 
skills depends primarily on linguistic processes. If for no other reason, 
motor skills are retained longer than procedural skills (Prophet, 1976; 
Schendel, Shields, & Katz» 1978), The thinking is thai motor skills have more 
intrinsic organization. If their organization and production depended only on 
linguistic representation, why should they be better organized than procedural 
skills? Furthermore, retention is enhanced when verbal rehearsal is accom- 
panied by actual movements involved in performance and feedback stimulation 
frcxn them. Even though verbal rehearsal can be substituted on a one-to-one 
basis for some manual trials in learning some tasks (Wheaton, Rose, i-ingennan, 
Korotkin, & Holding, 1976), it will not work for all trials nor all tasks. 
And when it works, the learner must have had sufficient perceptual-motor 
experience to give a sense of reality to verbal rehearsal. Otherwise, mental 
rehearsal aids only in remembering the sequence of an action; It does not 
facilitate response production (Newell, 1981). 

One upshot of this discussion is that part-task and low-fidelity training 
devices cannot be designed strictly on the basis of modern theories of 
cognition and cognitive lea»"n1ng. They make no provisions for retention and 
utilization, and hence the production, of nonl i ngu1 stic components of actions. 
Part'- task . and low-fidelity devices can be successful only if substrata of 
nonn'nguistic experience are taken Into account. As just suggested, there is 
likely to be little profit in viewing linguistic and nonl i ngui stic aspects of 
skills as separate systems, which could imply they could be learned separately 
and then synchronized. This would certainly be convenient for part-task 
training and for the use of low- fidelity devices; but 1n all probability 
linguistic and nonl 1 ngui stic aspects are part of the same system, in which 
case their integrative, mutually supportive roles should be a paramount con- 
sideration. Fischer (1980) presented a model that could be helpful in this 
respect. 

The other topics of this subsection, monitoring and regulating perfonnance, 
are covered in vario\js discussions in Section IV. The central process is the 
recognition and interpretation of cues with attendant actions. The present 
treatJTient of the topics will be limited to providing a perspective for them 
within the framework of cognition. 

Earlier discussions of executive processes stressed the roles of task recogni- 
tion and comprehension and the planning of perfonnance.. The occasion for task 
perfonmance must be recognized, together with contextual variables that indi- 
cate required adaptations; skill schemata, the structures of understanding and 
performance, should reflect coherent integrations of tasks comprising the 
skills, correspondent relations to the actual structure of the occasion, and 
"connectedness" with other knowledge sufficient to transcend peculiarities of 
individual occasions; plans, i.e., adapted schemata, for performance should 
include checkpoints or.subgoals which in turn become cues to continue or alter 

the action pi an. 

I 

In probljem solving, the checkpoints are the primary concern for monitoring and 
regul<»ting progress • They are also critical for task perfonnance generally. 

1 
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In the latter case, however, less deliberated monitoring and regulation are 
required.^ In a sequential procedural task, for example, a wrong button might 
be pushed, an indicator misread, a part of the task sequence reversed. The 
operator should be able to catch such inadvertent errors immediately on their 
initiation. In terms used earlier, the operator should experience dissonnance 
or disequilibrium between events and expectations. 

When speed of performance is not critical, action plans can include check- 
points that signal any errors made enroute. The checkpoints would serve the 
same purpose as multiplying a quotient by a divisor to see if a division 
problen had been completed correctly. (Computer models of problem solving 
omit realisti': steps such as this.) Procedural tasks and equipment involved 
in them can be designed to keep the operator safely alert to deviations in 
performance. When speed is an issue, however, the experience of dissonance is 
more likely to depend on sensitivity to task-intrinsic feedback, often of a 
proprioceptive nature. "Open-loop" skills under "programmatic" control (see 
Section IV) such as rapidly firing a weapon are often consummated by the time 
feedback is available. 

This is not to say that, as some have thought, feedback is not monitored in 
skills of this nature. A baseball pitcher usually knows when a wild pitch is 
on the way before the ball leaves his hand. However, whatever feedback is 
involved, it does not stop the throw; the feedback is operative only at what 
Glencross (1977) called a higher executive level. 

Training personnel to monitor and thereby regulate performance must take the 
availability of effective feedback into consideration. Executive control of 
an ongoing action is possible only when there is time to act on feedback. 
Therefore, rapid, open-loop skills require a higher degree of mechanization, 
meaning more practice, than do closed-loop skills in which negative feedback 
has the role of a servomechani sm .2 Even so, open skills are usually learned 
in a closed-loop paradigm, i.e., by performing slowly and monitoring each 
stage, interrupting the action if necessary. The training problem then 
becomes one of capitalizing on'the closed-loop paracligm early in training but 
without introducing persisting interfering closed-loop habits. As has been 
demonstrated, typists and rjiusicians cannot perform expertly if they watch 
their fingers (Adams, 1971 ).\ 

EVALUATING PERFORMANCE. In\ problem solving, evaluating performance means 
simply assessing the extent to; which a solution is responsive to and resolves 
the problem as formulated. By extension, evaluating the performance of any 
task means assessing the outcome vis-i-vis . the purpose. This may not be a 



The same can be said for problem solving, 
test for a component during troubleshooting is 
there was an error in the analysis of equipment 
subgoal invalid. As Bower (1978) pointed out. 
not ir^orporate incidental errors, false starts, 
performance. 

2Ada«is (1958, 1971, 1977) tends to view all 
See Section IV. 
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Achieving a subgoal such as a 
of little use if on the way 
functioning that rendered the 
models of problem solving do 
etc., characteristic of human 

motor skills as closed loops. 
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simple matter In either case, especially when 111 -structured problems ^nd 
tasks are involved. 

Analogy problems as often appear on high-level aptitude tests can demand very 
careful thinking and analysis. An example using an analogy problem will help 
illustrate the complexity of cognitive processes involved in evaluating per- 
formance (and why the Miller Analogies Test can be frustrating). Given the 
question stem, Hand is to dove as Foot is to , and the options, (A) 

Ankle; (B) Shoe; (C) Swim-fin; (D) Galosh; (E) Sock. (This example is not 
recommended as an item for a test; the intent is to avoid prolonging the 
discussion through combining all examples into one.) Most would probably 
agree that (B) is the appropriate answer, although a strong case can be made 
for (D). It depends on how one defines-~recogni2es-~the problem. Glove is an 
outer covering for Hc.id, as Shoe (not Sock) normally 1s for Foot. But Galosh 
is an outer covering for Shoe. For most persons the "normal" relation, the 
one requiring least analysis, would be preferred. Suppose, however, that 
option (B) had not been offered. The choice now, or so we will suppose, is 
between (D) and (E). Again, Sock is a normal covering, but' now one might be 
forced to consider redefining the problem. Glove protects Hand from the 
coid, and Galosh protects Foot from snow and slush. Sock offers no such pro- 
tection. Is the problem one of normal covering or protection? Suppose next 
that (B), (D), and (E) all are replaced as options with (for present purposes) 
irrelevant substitutes, leaving Ankle and Swim-Fin as the options to consider. 
How might the problem be recognized? A baseball Glove is an extension of Hand 
that aids Hand in its function of catching a ball. A Swim-fin is an extension 
of Foot that helps Foot in its function of propelling a swimmer. Ankle it 
seems is not in the running. \ 

In the final analysis, there are several correct answers, depending on how the 
problem is recognize^l. Stated formally, the good analogy solver goes through 
four steps: (1) fonning an hypothesis regarding the Hand-Glove relation, 
i-e., defining or recognizing the problem in a way that creates an expecta- 
tion ; (2) applying the hypothesis analogically to Foot unti I a candidate mate 
IS Identified; (3) testing the hypothesis by discriminating the precision with 
which the candidate mate confonns to the Hand-Glove relation, as (tentatively) 
defined; and (4) if a less than perfect "fit" is found, returning to the 
original proWem statement for a new analysis of the relation an^ a repetition 
fif the process. (A really dirty analogy item is one in which several or all 
options are near-misses unless the relation is defined in terms of the number 
of letters the words contain, in which case Ankle might be the correct answer 
in the example above.) 

That these fdur steps are not unique to solving analogy problems on aptitude 
tests is evidenced by the extensive amount of study of them in traditional 
research on problem solving. The steps reveal how the evaluative action, step 
3, must be derivative of steps 1 and 2, and how the results of evaluation can 
either terminate the problem or result in further effort through stfep 4. 
Common experiences with automobile repairmen reveal that many professional 
mechanics never get beyond the first two steps. If the symptom is such and 
such, replace part x. The "repair" is consummated, the customer pays. But 
was the replaced item actually at fault? As the military has found, many 
line-replaced units were in perfect working order when received by a repair 
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depot. Whet was lacking was appropriate discrimination on the part of the 
repairmen as called for in Step 3. 

As applied to the evaluation of task performance generally (recall that a 
novice approaches a task as if 1t were a problem, sometimes a strange one), 
the conclusion is that adequacy of any skill performance requires that (1) the 
purpose or^ goal be clear and v»rt?ll defined; (2) Interrelations of component 
tasks vis-a-vis the purpose be clear; (3) correspondence of the cognitive 
representation of the task to the situation be complete; and (4) plans for 
performance include clear (and appropriate) expectations for the outcome. 

This discussion may appear to have belabored the obvious. If so, the 
impression will be different when the complexity of goals and goal-setting is 
considered in Section IV, along with the effects of fatigue on all the cogni- 
tive executive functions just listed. Further evidence of the need to spell 
out the requisites for evaluating one's, own performance was alluded to 
earlier. Many military training programs focus almost exclusively on manual 
operations; understanding of performance is restricted to what an operator 
"needs to know" for mechanical execution of tasks. What was termed "organic" 
knowledge- -the basis for precise self-evaluation of performance as well as for 
transfer and other adaptive employment of skills--is often deliberately 
excluded from training.! 

As stated earlier, probably not every operator needs the scope and depth of 
understanding Implied by the foregoing discussions. Nevertheless, when opera- 
tors are trained with part-task and low-fidelity devices, eventual skill 
integration and transfer of the training to operational equipment and 
situations will require some level of "organic" knowledge. It is just as well 
to outline what is involved so when some asper+s of understanding are omitted 
from training, one can know what to expect. 

SHORT-TERM PROCESSES 

"Short-term processes" refer to the immediate perceptual-cognitive inter- 
face of a person with a situation to which he is reacting in some manner. 
They are brief, transitory, and situation-specific. These processes are com- 
monly ascribed to STM, WM, and/or other facets of immediate memory (iconic 
memory, episodic memory, etc.) working in conjunction with STW and WM. There 
are four sets of short-term processes of present, concern. One, the accessing 
of LTM and related executive functions, was covered by implication in the pre- 
ceding discussion of executive processes. The other three are (1) encoding of 
inputs from the environment, (2) retention/retrieval of Inputs, and (3) 
transfer of the new infonnation to LTM. 



The writer prefers not to document this and a similar earlier assertion 
with examples because there is nothing to be gained for present purposes by 
calling the personnel Involved to task. Suffice it to say that graduates of 
one training progran to which he raised strong formal objections later had 
85-93 percent failures on field tests of some skills. The training targeted 
STM only, and through Immediate repetition of demonstrated steps. There was 
strong resistance to distributing practice, even to testing the trainees so 
much as a 6diy following training. 
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The last three processes could be viewed, as they often were in the past, 
as more or less independent of each other. Immediate encoding, for example, 
might index a sensory icon phonemically for storage in M; as long as the 
capacity of STM had not been exceeded, all inputs could De retained provided 
they were constantly rehearsed, and retrieved ( recalled) through a serial 
search of STM for the phonemic "tab"; transfer to LTM depends on rehears?-l in 
STM (to avoid forgetting) until it is organized semantical ly for storage in 
LTM, 

However, as stated earlier, encoding in STM quite clearly seems to 
involve the same processing (e.g., semantic organization) that results in 
transfer of STM contents to LTM. In turn, such encoding processes are 
rehearsals, at least up to a point. In a training situation, then, encodTTig' 
is the critical short-tenm process. Accordingly, the analysis below empha- 
sizes encoding as the central concept. Because of the manner in which 
encoding is addressed, the other two topics, retention/retrieval and transfer 
to LTM, are discussed under a single head. 

ENCODING. Bower (1972) identified presumed steps of encoding that conform to 
the view of the process adopted here. First, from a complex pattern of 
inputs, one or more components are selected for attention. Second, the 
selected input is rewritten or transrormed into a suitable format (e.g., a 
verbal description)"! Third, there is then a componen ti a1 desc ri pti on of the 
transformed nominal input, i.e., complex features and attributes are 
abstracted and registered. And fourth, the nominal input is elaborated, 
through language, for example, resulting in an integration of relations that 
give the Input more associative mearijng, hence making it more easily 
remembered, at least under most conditions. 

Encoding is thus an organizational process. The issue is the nature and 
extent or level of the organization (Basden & Higgins, 1972; Craik & Tulving, 
1975; Craik & Watkins, 1973). Simple phonemic or iconic indexing, as would 
.occur at step two, may be thought of as the least comp, ;X. It is also charac- 
teristic of information for which the capacity limits of STM are most severe, 
and for which constant rehearsal is necessary for retention. Furthermore, 
contrary to a once common belief, rehearsal of phonemic information by itself 
does not ensure its transfer to LTM ( see review by Postnian, 1975, p. 311^). 
Step three, componential description, and step four, elaboration, become the 
basis for long-term retention. Typically involved in these p*^ocesses are 
transformations and recoding of inputs according to characteristics of con- 
tents and of processing within LTM. Again, encoding is the key concept for 
training, and the level of organization involved is the determiner of 
long-term retention. (This last statement will be qualified.) 

Selection of Components . The selection of components of sensory inputs is 
governed by attentional processes. In everyday life, a person processes a 
myriad of external stimuli, most of which are of no consequence to behavior. 
Just during a brief interruption of a task such as writing, the gaze shifts to 
several objects on the desk, a chalk board on the wal 1 , a file cabinet, 
various pieces of furniture, etc., but none of these is effective in deter- 
mining what is done next. They are clearly perceived, but they are not cues. 
The percepts are automatically set aside as the gaze shifts from place to 
place. 
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Although incidental learning and related perceptual processes are still o^ 
occasional interest in cognitive psychology, theories and emptrlcal studies of 
cognition are concerned not with inputs such as those but with carefully 
defined inputs that have known cueing value. The emphasis is certainly 
appropriate, but this is not to say that it should be an exclusive concern. 
The earlier discussion '^f cognitive dissonance or schematic dlrequllibrlum-- 
Simon and Hayes* leaki faucet^-is a case in point. It Is an extreme case, 
however; Feather (1971) provided a more general treatment of dissonance. In a 
verbal learning experiment, the subjects' attention is severely confined. In 
everyday life, actions require attending to ever changing inputs and screening 
them for relevance. Unlike a computer model of attention, everyday behavior 
is characterized by sensitivity to adventitious occurrences. I.e., nonlinear 
in the sense they result in abrupt changes 1n what is attended and what is 
done. (This is a limitation of current models only; computers have been able 
to handle nonlinear processing for some time.) 

There is at present no formulation of attention that takes into account the 
complexities of the processes involved. Instead, there are computer-like 
models that stress the rigid functioning of an executive process that is 
severely limited in capacity. In effect, it bolls down to the position that 
if two tasks are performed at the same time, at least one must be "habitual," 
thereby requiring no attention (see also treatments of this point in Section 
IV). Allport (1980b) made a strong case that various attentlonal phenomena 
ascribed to capacfty limitations actually require diverse explanations. 
Attention is a complex phenomenon, or rather set of phenomena. Intuitively, 
we attempt to adapt skill training to the complexity. The question is whether 
there can be systematic guides for the intuition. 

If separated from the notion of a limited capacity executive, the distinction 
between habitualized and deliberate attending can be helpful . Although issue 
will be taken with their dichotomy as such, Schneider and Shiffrin's analyses 
(Schneider & Shiffrin, 1977; Shiffrin & Schneider, 1977) of attentional 
factors in automatic versus controlled processing reveals some training 
Implications. According to them, automatic processing follows well 
established sequences controlled by LTM. Once activated, the sequence is 
self-determined. There Is no stress on the capacity of the system because 
little if any attention Is needed. Controlled processing requires deliberate 
attention because 1t involves a controlled search and conscious detection of 
signals. (Note that Schneider and Shiffrin made no major distinctions among 
processes of attention, search, and detection, a view adopted here. "In fact, 
in many cases it is purely arbitrary whether a given study is referred to as 
an 'attention,' 'search,' or 'detection' study" [Shiffrin & Schneider, 1977, 
p. 145].) 

Generalizing from their data and theoretical analyses. It appears that auto- 
matic processing--a must for many skllls-^develops through practice of 
controlled processing; that the shift to automatic processing Involves a 
qualitative change In the nature of processing; that the qualitative change is 
from "varied mapping" to "consistent manning" (see Immediately below); that 
the learning of controlled processing, and the shift to automatic processing, 
are facilitated to the extent that sensory Inputs can be categorized; and that 
once stabilized, automatic processing Is resistant to change. 
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As abstract statements, all of these generalizations can be readily inferred 
from traditional studies of skill learning, if Indeed not from studies of con- 
ditioning. But we are now more prepared to interpret the conclusions in terms 
of some specific variables. In Section IV, for example, the resistance to 
change of automatic processing of motor behavior is viewed 1n terms of reac- 
tion times and motion harmonics. The mapping concept further aids analysis of 
what 1s Involved. It also highlights an issue in training for skill 
generalization. 

Going somewhat beyond Schneider and Shiffrin's operational use of the terms, 
consistent mapping Involves stimuli, or with practice, categories of stimuli, 
that individually an? consistently either targets or nontargets for selection 
of inputs. Once learned, the process is simply one of immediate recoynition 
or pattern matching. If the pattern matches, a consistent response occurs; if 
not, no response, at least not to the characteristics of that input. Varied 
mapping involves stimuli that on successive occurrences individually change 
from targets to nontargets and vice versa. Fattern matching must thus Incor- 
porate situational variables, sometimes ranging the entire gamut of executive 
processes discussed above together with the contextual factors they consider. 
For this reason, deliberate attention on the part of the performer is 
required, with the correlated reduction in capacity to process information for 
different purposes simultaneously (Posner & Boies, 1971). 

It 1s appar:)nt that progress from controlled to automatic processing should be 
facilitated if only consistent mapping is required because only one set of 
discriminations has lo be mastered. Otherwise, consistency must be sought in 
higher-o'^der patterns that for rapid actions at least must be hierarchically 
organized (see Section IV). 

This last inference goes well beyond Schneider and Shiffrin's data, and 
apparently their theoretical formulation, and it would be well to clarify a 
point before further addressing training implications. Categorization as they 
treated it did not involve hierarchical organization. Indeed, such structures 
would involve a search, an activity characteristic only of controlled pro- 
cessing as they viewed it. But it is here that issue is taken with their 
dichotomy and the assumption of qualitatively different modes of automatic and 
controlled processing. Did the qualitative differences they found reflect 
typical complex performance or the arbitrary dichotomy of their stimulus sets? 
As 1s apparent In Section IV, programs and schemata for automated motor 
actions fist Incorporate what operationally Schneider and Shiffrin called 
varied mapping. Otherwise, motor skills could not be adapted even to minor 
variations in situations. Furthermore, as everyday experience as wel 1 as 
research implies, trainees' progress from novice to expert is characterized by 
the development of autonomous hierarchical discriminations of varied inputs as 
related to purposes (Norman, 198U). 

Al though the 1 ssue of automati c versus control 1 ed processi ng was not 
confronted as such, studies of purely cognitive skil 1 s lead readily to the 
Inference that variable mapping occurs in essentially automatic processing: 
the rcipld hierarchical encoding of stimulus letters that develops with prac- 
tice (Rabbitt, Gumming, & Vyas, 1979); the hierarchical organization of 
chunking by experts (Chase & Simon, 1973); the more rapid accessing of LTM by 
good readers (Jackson & McClelland, 1979); the experts' '^intuitive" 
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comprehension of a problem and derivative performance requirements which as 
Simon and Simon (1978) pointed out, teachers have known about for years 
(intuition would be the basis for the expert's ability to extract readily the 
relevant components of inputs [Bower, 1978]); the wide-ranging memory 
"template" of expert chess players (Simon, 1979, though template was not his 
term--see Section IV); the "indexing" of recognizable patterns which "gulde(s) 
the expert in a fraction of a second to the relevant parts of knowledge store" 
(Larkin, McDermctt, Simon, & Simon, 1980, p. 1336); the self-sustaining 
employment of rules by the competent performer (Glaser, 1976); and when 
applied to continuous ongoing performance following mastery, most aspects of 
understanding as discussed by Greeno (1977, 1978j^, 1978^). 

This digression indicates the complexity of the learning one must acquire to 
progress from novice to expert, and the practical futility of viewing perfor-. 
mance in terms of a few discrete, mutually exclusive categories of encoding 
(or of anything else). Progression is in rriany respects from controlled to 
automatic processing of inputs (Neves & Anderson, 1981; Shiffrin & Dumais, 
1981). But automatic processing is not a discrete Jump from a controlling 
hanunculus--the "ghost-in-the-machine" ( Al Iport, 1980b^)--to a mechanical 
habit. Nor is automatic processing a matter of "consistent mapping" of 
invariant stimuli in Schneider and Shiffrin' s (1977; Shiffrin & Schneider, 
1977) sense of the term. Rather, progress is toward consistent mapping of 
varied inputs onto hierarchical schemata. Moreover, controlled processing is 
required for autonomous action systems to the extent that perforinance must be 
planned and regulated according to the peculiarities of immediate purposes and 
situations. And contrary to Shiffrin and Schneider's (1977) conclusion, the 
interplay of controlled and automatic processing should not be viewed as basi- 
cally interference. In skill perfonnance, planning, monitoring, regulating, 
and evaluating are controlled processings that must support, and be supported 
by, automatic processings. The issue is one of integration. 

The interplay of these modes of processing is the central concern in training, 
and the source of a significant uncertainty regarding training design* Should 
early training involve only consistent mapping? It speeds acquisition and 
performance stabilizes sooner. But there Is a danger of fonning restrictive 
sets such as functional fixedness that prevent creative utilization of skills. 
There is also thf problem that skills so learned are subject to devastating 
Interference when perfonnance conditions introduce varied si /null. So 
assuming consistently mapable stimuli are used at the outset, at what point 
should varied mapping be introduced? How much stimulus variability should 
there be and at what rate of change? Perfonmance will almost surely deteri- 
orate at first. How much deterioration can be tolerated before it becomes 
counterproductive? How does spacing of practice affect deterioration? 

These and a number of similar questions are not easily answered. In fact, 
there seems to be confusion over what is involved in answering them, a con- 
fusion that may at least have been clarified here. Typical studies, involving 
relatively simple skills and perfonnance only over a limited time span, pose 
the question operationally (i.e., experimentally) in such ways that ostensibly 
conflicting results are common. Newell (1981), for example, concluded that 
"the benefits of variable practice have yet to be unequivocally established" 
(p. 223- see also discussion of "The Variability and Specificity of Encoding." 
Postman! 1975, and "Encoding Specificity." Peterson. 1977). Yet. who would 
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train a shortstop or a tennis player to respond only In a single manner to 
balls moving only In a consistent stimulus matrix? Or a pilot to always begin 
a ma.reuver from a single complex of conditions and execute It in only one way 
Ignoring purpose, altitude, airspeed, and wind conditions? 

Componential Description and Elaboration . To a great extent, the resolution 
01 the training issues, and of the conceptual confusion, seems to lie in 
Bower s (1972) third and fourth steps of encoding listed earlier. What 
features are extracted from Inputs and how are they elaborated? What is the 
relation of componential description and elaboration to functional structures 
(in the sense of Handler, 1962) of LTM? We speak here of the activation of 
habitual processing systems (Paul & Paul, 1968)--learning sets— that trainees 
bring with them, anu which must be built upon, altered, or replaced as perfor- 
mance requirements dictate. Features of an input, abstracted according to 
individual proclivities, are clustered according to one or more functional 
structures of LTM (Handler, 1957). They are recoded or transfonned following 
the psychological equivalent of physic's least action principle, or what some 
wag called the "principle of cosmic laziness." As mentioned earlier, semantic 
organization had not been found in STM simply because tasks had not required 
1 t ( Shulman, 1971 ) . 

It is beyond the scope of this report to explain what 1s known, which is not 
inconsiderable, about componential abstraction and elaboration processes. 
Suffice it to identify the nature of the processes involved, and then Indicate 
how they can help clarify confusions regarding variable practice. A variety 
of mnemonics come into play, most of which have been treated as linguistic in 
nature ( cf_. . Pressley, Levin, & Delaney, 1982; see especially Bellezza, 1981, 
for hierarchical mnemonic cueing systems of a linguistic nature). But spatial 
representations can be very effective (Greeno, 1978b^). Also, Imagery has had 
a rebirth. Of five classes of mnemonics discussed by Norman (1976), two 
(visual imaging and spatial location) clearly have perceptual referents; 
Turvey (1978) built an entire model of visual short-term processing (he also 
presented a useful review of research on interference in visual processing); 
Shepard and Podgorny (1978) integrated perceptual processes fairly thoroughly 
into the overall cognitive matrix; proprioceptive imaging, even to the extent 
of comprising the structure of expectations for feedback, has been emphasized 
in motor performance for some time (see Adams, 1968, for a brief review). . 

Yet, Anderson and Bower (1973), for example, rejected images in favor of 
"propositional " (linguistically formulated) representation. As stated 
earlier, imaging in LTM should be assumed, at least for habitual behavior with 
motor components, probably including speech. At the turn of this century, 
research still focused on showing that something other than sensory images 
comprised thought, an assumption born in the British empiricism of the 
eighteenth and nineteenth centuries. The rise of the Wurzburg school and the 
fall of structuralism resulted from their success. Even so, behaviorism 
resorted to proprioceptive representations of speech to explain thought (e.g., 
Watson, 1930, Chapter 10). The evidence for imagery representations, on which 
Titchener and Watson based their quite different systems, is now Ignored. One 
experiences deja vu in reverse. While once we sought imageless thought, we 
now set about proving that something besides words and semantics functions 
beyond the stage of immediate sensory inputs. As suggested earlier, if this 
were not t!ie case, a young child could not remember, much less, think. 



ERIC 



59 

63 



NAVTRAEQUIPCEN 78-C-0113-4 



Manipulati on of Encoding for Training . As stated, modern analyses of cogm- 
t?on enable us to view traditional gross generalizations from learning 
research in ter^s of particular processes. This is not to say that the pro- 
cfsse^are well understood. Rather, we at least know some places to look for 
g ce forlraining design. While it is beyond the scope of this report to 
examine the processes themselves in detail, what is involved can be outlined. 

The problem can be approached from several angles, but there are two basic 
considerations regardless. First, the cueing systems, which include responses 
"explained n Section II. need appropriate hierarchical structures Second 
disruptive interference has to be minimized during both short-term and 
long-tenn processing. 

Appropriate cueing structures are a matter of adaptive schemata. These vary 
with the skill and the conditions for its employment. Therefore the first 
step is a cognitive analysis of the skill. Following Greeno's (19 7) enter a 
discussed earlier, component tasks should be organized cognitively so as to 
have coherent organic relations with each other. The cognitive represen- 
tation of the tasks should be such that the performer can. and is Ijkely to. 
tr sfonn them and situational inputs to achieve correspondence. onnected- 
ness should be such that specific or nonspecific transfer is made readily. 

What is involved in an analysis of this sort goes far beyond task analysis as 
ordinarily conceived (Caro et al . . 1981; Prophet et al . , 1981). It is 
ne2e ry' to deTi'ieate the contents and functional structures of schema 
or examples of task analyses in cognitive temjs '^'^^'ZTn^n^^^^^ 
Gunstone (1982); Greeno (1976, 1978b); Newell and Simon (1972), Resmck 
(1976^ and Simon and Simon (1978). Th-ese examples are quite involved, but as 
Farnham-Digqory (1976) said, a belief that simple representations of cognitive 
ta'k analy^^^^^^^ an illusion. A fairly , detailed analysis is 

^e4d to'gu^do^the"manipulation of short-terai processes during training, and 
to design instructional equipment to aid in the manipulation. 

The manipulation of encoding processes would focus on tlie kind and level of 
I^Lorati on required to conform to the long-term cue-response structure 
^pf?nPdn the task analyses. There can be a variety of elaborative processes 

«£v.-';t^?it:frt4ri-s?;L ^^^^ 

otherwise might not occur (Anderson & Biddle. 1975). Imaging and other 

mn^oniVmethods. and questions that need answering, see Bellezza. 1981. and 
Pressl ey et al . , 1982 . ) 

o5?;'supeXaUy Vn^eseVrch 0^^ SnUary training. Ms also long been known 
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to transfer to later learning (Arnoult, 1957). Numerous studies of advaf>ce 
organizers have shown clearly positive effects, but the number of negative 
results indicates a need to understand them and their roles more fully (Barnes 
& Clawson, 1975). Just how instructions are given (Hayes & Simon, 1974; Simon 
& Hayes, 1976) and how task requi rements and formats are presented (Kayes & 
Simon, 1977) make a difference. Cognitive systems employ "utility consider- 
ations" that can incorporate a number of mechanisms in different ways, with 
the efficiency depending on perceived parameters of the task (Navon & Gopher, 
1979). And there is still emphasis on guiding learners' elaborations to rules 
and general principles that was stressed by Haygood and Bourne (1965). 

The complications involved in manipulating encoding processes lie in complex- 
ities of Interference. Until modern analyses of infomation processing, 
interference was viewed in terms of its gross effects on criterion responses, 
i.e., response production. No wonder there was confusion over the effects of 
spaced versus massed practice and of delays in feedback. As just stated, one 
has to consider elaboratfve processes that may or may not occur in the 
interim. We now know that the gross effects are resultants of what happens 
prior to response production, of complex interplays of competitive versus 
facultative components at every stage and level of processing. In fact, 
localization of interference has been a major criterion fur identifying 
separate perceptual, cognitive, and motor processes and distinguishing among 
them. The complexity begins with attention (cf. Mackintosh, 1975), the sen- 
sory input stage, and the first perceptual processing of the input (cf. 
Breitjnan & Ganz, 1976; Duncan, 1980; Hayes-Roth, 1977; Kaufman & Levy, 1977; 
Turvey, 1978) • Interference at these stages was not considered in earlier 
learning experiments (it was in studies of sensation and perception per se, 
however). Interference continues, and in ways not understood, through 
competitive modes of subsequent encoding, feature abstraction, elaboration, 
even groupings within hierarchies (Postman, 1975). Interference affects long- 
term schematic processes, which also generate their own Interferences. And 
the eventual impact on response production depends on how learners resolve the 
i nterference. 

In addition to clarifying loci of interference, modern analyses of information 
processing bring to light possible mechanisms of interference that were here- 
tofore Ignored, Traditionally, stimulus and response, i.e., input and output, 
compatibilities have been considered the pr+mary sources of competition that 
lead to forgetting or disruption of performance. It now seems clear that com- 
petition can arise from the processing itself. For example, two concurrent 
tasks may be performed without di f f icul ty ^under most conditions, yet at the 
limit (of speed, for example) seriously interfere with each other. The inter- 
ference could well be due to both tasks using the same mechanisms of error 
detection and thus regulation (AHport, 1980b). Under normal conditions, 
employment of the mechanisms may be alternateT or otherwise coordinated; at 
the limit, the coordination may proves" nadequate or even impossible. Could it 
be that training for tasks that must be perfonned concurrently under stress 
should target separate systems for error detection? As for the compatibility 
issue, i.e., stimulus-response similarity-dissimilarity, ^t may or may not 
help to analyze the problem in terms of cognitive similarity (Ortony, 1979; 
Tversky, 1977; see also Gagne, Baker, & Foster, 195C, and Wallach, 1958, for 
an earlier recognition of the need). At any rate, it would be closer to the 
problem than the traditional treatments of similarity and consistency 
discussed in Section II. 
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When Interference was mentioned earlier as one of two basic considerations in 
clarifying training issues, disruptive interference was emphasized. The 
reason was that when viewed at the level of separate cognitive processes, 
interference may be desirable as well as undesirable. Not only can visuai 
pattern masking obscuTe a signal, it can eliminate irrelevant stimulus inputs 
that would confuse a signal. At a higher level, transitory sets may pre- 
dispose one to misinterpret some information, yet enhance the processing and 
utilization of other information; or long-term learning sets that are rigid 
and inflexible will prevent analogical scherriatic performance, but they are 
needed for skills requiring stereotypy of actions. Such is the problem of 
negative versus positive transfer. 

Cognitive task analyses delineating these processes should among other things 
clarify the nepd to provide for consistent versus varied stimulus mapping, 
indicating the range and hierarchical order of LTM patterns to be matched to 
inputs This knowledge 1s critical tc optimum design and use of part-task 
trainers for the hierarchical ordei- Sf patterns of inputs in part-tasks in 
relation' to whole tasks will determine how part-tasks must eventually conform 
to an integrated structure. The instructional goal is to bring varied mapping 
of stimulus Inputs to taw. What transformations can be learned for skill 
robustness for making varying patterns of inputs have topological discrimina- 
tive consistency even though task and situational requirements ostensibly 
vary? U was suggested earlier that hierarchical processing is required, 
characterized by T.reeno's ( 1977) criteria f o - understanding, especially 
transformations required for correspondence. 

RETENTION/RETRIEVAL OF IMFORMATION AND TRANSFER TO LTM. If encoding does not 
advance beyond the essentially perceptual process of attentional selection, or 
perhaps simple phonemic or other indexing, time limits on retention are severe 
unless there is fairly constant rehearsal. The maximum duration is generally 
no r^re than 20-30 seconds (Lachman et al., 1979). Several studies have 
attempted to determine the reason for the loss. Does retention s mply decay 
with time or is forgetting due to subsequent inputs that bump old contents 
out of a process of severely limited capacity? Tfie. answer to this question 
need not concern us. As explaine,d_ under Encoding., the capacity of STM can 
be manipulated; as stated earlier. Chase and Ericsson's (1981) subjects could 
retain more than eighty digits in STM after two ye,ars Practice. The important 
point for training is to distinguish between what-can, or should, be forgotten 
and what should not. and adapt training procedures , J" . 

data into a keyboard, for example, a unit of fou^ or five digits has to be 
retained no more than a second or so at most. A skilled operator may well 
perfonn such a task perceptually (recall ^hat associated responses are part of 
the cue matrix). It is actually desirable in such instances that the nfor- 
mation be lost from STM immediately after entry. Otherwise, it would likely 
interfere with the next data unit to be entered causing '^''''O'"^. Hence both 
speed and accuracy depend on as little phonemic indexing as possible. Touch 
typing and similar keyboard operations accomplish just triat. 

Other kinds of inputs n^ed longer, but still relatively brief retention. 
Such would be the case when all pertinent Information is not simultaneously 
available or when decisions or actions indicated by the input endure for 
several- seconds or minutes. An example is a pattern of variable Instrument 
readings on an electronic test stand. In this task the c erator needs at 
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least a rehearsal strategy to ensure adequate retention of moment- to-moment 
Inputs and their changes. If actions or judgments depend on patterning of 
Inputs, encoding must advance at least to the level of feature abstraction 
{Bower's, 1972, step three). Elaboration may be required as well. 

Except for the purely perceptual encoding In the first example, thes^ pro- 
cesses have been considered to lead to long-^term retention. While most 
theorists today no longer believe that simple rehearsal Is effective for 
transfer to LTM, a few theorists have recently held out for at least some 
transfer (e.g., Glanzer, 1977). But this issue need not concern us either 
except as explained below. To be functionally effective, contents of LTM 
require organization, a process that must begin during encoding. 

This Is one example of the need for cognitive task analyses. What should 
trainees process rapidly and* forget rapidly? What should be rehearsed for 
temporary maintenance only, and what rehearsal strategies are most effective 
in minimizing Interference? What kinds of patterning of Inputs, i.e., cogni- 
tive structures of features to be abstracted, are needed for discriminative 
cueing? What should be elaborated and how? What can be taught with, say, a 
low-fidelity device without Introducing Inefficient abstracting and elabora- 
tlve schemes? Such could happen, for example, if trainees learned habitually 
to route symbolic inputs through a semantic elaboration, when with actual 
equipment the stimuli would have physical representation and the input should 
be processed only at the perceptual level. 

Training should target the answers to these questions, and it is apparent that 
grossly generalized training principles provide little guidance. "Trainees 
should practice verbal rehearsal "--of what in particular, , focusing on what 
abstracted features, and for how long? But there is an' addi tional question: 
What information should be transferred to LTM? . 

This last question reveals a serious gap in our knowledge of memory. Craik 
(cited in Bower, 1975) made a very useful distinction between maintenance 
rehearsal and that Involved in semantic organization. As just suggested, 
maintenance rehearsal results in little if any transfer to LTM while semantic 
organization does. But does all oj^ganized knowledge wind up in LTM? Should 
it? The gap in our understanding 'is illustrated by a memory peculiarity of 
waiters who take pride in their profession.! prideful waiters do' not write 
down each diner's order. When after an hour, often much more, time comes to 
prepare the check, there is no difficulty in remembering what each diner 
ordered. After the check is paid and the diners leave, but return shortly to 
question the waiter, he has forgotten almost all of their orders. 



This example 1s presented as an anecdotal observation. It follows my 
memory of a study done many years ago. Unfortunately I have not been able to 
locate the report or a reference to it. According to memory, the study was 
done by Kurt Lewin and/or one or more of his colleagues to demonstrate the 
efficacy of Gestalt patterning In what we now call working memory. As remem- 
bered, the example was much more impressive than this account, but I fea,r 
overdoing It. As presented, the observation can easily be confirmed. 
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This is apparently ' an everyday occurrence for everyone, though probably 1n 
most cases the occasion of closure^ (paying the check) is not so discrete, so 
the forgetting is not abrupt. The point is that considerable elaboration and 
organization is necessary to retain such fnformation, but it has no place in 
LTM as conceived. An operator must have appropriate sets to elaborate and 
organize information derived from instruments and a host of other external 
sources, and the sets must be maintained fron: minutes to hours, even days. 
But the operator who stored the information permanently would find his LTM as 
hopelessly cluttered as that of a hapless waiter who could never forget 
anyone* s order. 

The concept of working memory helps here, but as presently formulated it is 
hardly a comprehensive conceptual tool. It does not guide a training devel- 
oper in providing for LTM or not, according to need. There are various 
empirical data, old and new, regarding intentional learning, differential 
'^learning of materials, etc., that are applicable. But though the roles of 
these factors have Deen recognized in modern theories of memory (e.g., 
Montague, 197?^), they have not been formulated sufficiently to guide syste- 
matic extrapolation to training problems. An operator must intend to learn, 
from moment to moment or hour to hour, the status of various inputs, to dif- 
ferentiate among them, even if they are to be washed out once the task is 
co<nplete. What is the difference in intentions or differentiations that lead 
to long-term retention and those that do not? Vividness is one difference. 
As Mark Twain sai'', "A man who sets out to carry a cat home by the tail is in 
for an experience he will never forget, one that will never grow faint or 
dim," Yet even in its simpler aspects, vividness is a complex phenomenon and 
its manipulation quite complicated (TayTor & Thompson, 1982), 

As Montague (1972) titled a section, "To Store or Not to Store, That is [the] 
Selection." The designer of training and related equipment must find his own 
answers. The^ guiding hypothesis is that cognitive task analyses should 
distinguish clearly between content to be retained indefinitely and schematic 
processes for organizing coi^tenT: The processes, necessarily analogical, are 
to operate on tanporal contef^t, yet be independent of temporal content except 
to the extent its transformations are required to establish functional equiva- 
lence to LTM content associated with the processing. Training to process thus 
involves all the varied stimulus mappings and variable training that lead to 
generalized discriminations. 

LONG-TERM PROCESSES 

Long-term processes are essentially those that underlie schematic opera- 
tions discussed under Executive Processes, and feature abstraction and 
elaboration discussed under Encoding. They involve both organized content and 



.^"Closure" is used in its' technical sense in Gestalt psychology. A lot 
of work was done on the effect of lack of closure on retention following 
Zeigarnik's 1927 report that uncompleted tasks were ret>AlJ^ed better than those 
that had been completed (cited in Woodworth ift SchlosbergTW4) . *^he theo- 
retical issue was poorly defined so It was not clarified. The Zeigarnik 
effect has been recognized in more recent cognitive psychology , however 
(Baddeley, 1963). 
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schemata for manipulating the content according to situational inputs. Except 
in these con*:exts, which by no means are minor considerations, long-tenn 
processes have received little attention in modern cognitive theories. 

So there remains to emphasize three points that are implicit in cognitive 
science but which have been known for some time. A simple example illustrates 
the points explicitly. A "memory expert** asks twenty persons In the audience 
to each call out one word, A twenty^first person is designated to write each 
word down in numerical order so the expert can be checked. When all words 
have been called, the expert then repeats them forward and backward. He asks 
the audience to call numbers from on^ to twenty and immediately gives the word 
for each numerical position called. 

Very Impressive. But anyone with normal intelligence can do it with the 
right preparation. Indeed, normal people perfonn much more complex memory 
feats throughout the dey. With due caution to focus on the learning and 
behavioral issues, not the mnemonic preparation, how the memory expert pre- 
pares for the task reveals the most fundamental considerations in complex 
behavi or . 

The expert has his own list of twenty words. First, ti^ese words are 
thoroughly mastered , including their numerical designation. If someone 
slipped up behind nim and shouted "thirteen" his thirteenth word would have 
flashed in his mind by the time he gave a startled jump. Second, each of his 
words has a broad associative context . That is, it can be associated 
meaningfully ana immediately with any word likely to be called. 

So far, the numerals 1 to 20 satisfy the requirements for the expert's 
list of words. If the fifth word called is Clock and the sixth Table, one can 
readily come up with 5 Clock(s) and 6 Table(s), But it won't work. Every- 
thing is enumerated and all discriminations occur in the enumeration--5 is 
less than 6--not between Clock which is not less than or anything else than 
Table. (Let's see now, was it 5 clocks and 6 tables--no, maybe it was 12 
Clocks and only 2 Tables.) 

The expert's words must have discriminative associations. If the fifth 
word in his personal list is Hand and the sixth Leg, he is not likely to 
confuse "Hand on Clock" with "Leg on Table". 

These di scrimi native associations may be short-term or long-term. In 
teaching what he is now expl ainir\g> the writer has used thi s stunt in two 
applied learning classes the same term without disruptive interference. 
Though th'^s statement 1 s important as suggested above, here i t pursues the 
gimmick, not the learning principle, so we will drop it. 

The learning, ul timately performance, principle is that trainees shoul d 
master a broad, discriminative associative! structure for their skills. 



"Associative" Impl ies no partlcul ar theoretical position on the 
"association" versus "i ntegration" basi s for LTM processes ( see CI ax ton, 
1980c). Although the writer, along with others (e.g., Anderson & Bower, 
1980T, leans toward an associative interpretation of most LTM processes, the 
tenn is only descriptive as used here. There is no need to fetter the concept 
with theoretical baggage. 
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Breadth and di scrimi natlo'n were treated in detail under Executive Processes 
and Encoding, The need for mastery is intuitively clear if we ask whether the 
memory expert could succeed in gulling his audience if he had to struggle to 
recall his own list of words; or just as important, if he could not remember 
imniediately the serial position of each word in his personal list but had to 
do a serial search, counting through to, say, 18 if a member of the audience 
said, "What was the eighteenth word?" (The reader can surely infer the 
writer's opinion of "training to proficiency" when this criterion is defined 
as it often is in military training.) 

' . / 

Here we confront the search issue in retr/ieval/ of information, another of 
the many processes that were not even cotisidered until modern cognitive 
theorists forced us to recogniz^^ the gaps Jn our knov/ledge of what goes on 
between a stimulus and its response. How does one retrieve information from 
memory? There are many ways one might / retrieve, so what strategies of 
retrieval should trainees learn? What shoi^ld they key on? How can retrieval 
be taught? 

It is easy to program a computer to/ do a serial search, for example, to 
start at the expert's first word and by seeking matching patterns continue 
until the numericdl tab for a word matches the number of the audience member's 
challenge. Computers do this quickly, much mOre quickly than can our expert 
who should smile urDaricly while giving an immediate answer that obviously did 
not require a lengthy r.erial search/. Yet beqause of the near equivalence of 
the computer's and subjects' speed in serlail retrieval of words in verbal 
learning experiments, it has been argued thatj retrieval Is basically a matter 
of serial searching (e.g., Anderspn & Bower, lj973). 

Now there is ample experimental evidence jthat all memory searches a\e not 
serial (Anderson S Bower, 1980; Evans, 1980). i Serial ity may cnaracto^'ize STM 
if encoding has not progressed beyond the phonemic or indexing stage, but what 
of LTM and results of STM encoding that depef^id on contents and processes of 
LTM? Without prejudice as' to the training yalue of modern conceptions of 
retrieval, or traditional interpretations of what is involved in recall in 
verbal learning experiments, the provincial interpretative restrictions of 
laboratory studies should be recognized. Surely, not even an avid proponent 
of serial search would insist that all rontents\of LTM are candidates when a 
STM pattern io to no [patched to o LTM pattern. \There must be some selection 
at the outset. Otherwise the search wou^d reqiiire delving into the nether 
reaches of LTM, Inrludiny the unconsc ious--the \realm of the Id, what Rex 
Stout's fictional detective Nero Wolfe likened to\a sewer. To check through 
the indexing tabs, let alone seinantic and other patterns, of contents of an 
operator's; total LTM would take the computer on an interminable (but 
interesting) journey. \ 

This reductio ad absurdunt is to etnphasize two points. First, until quite 
recently, theo'Fel.Tfal Folniurnitions of retrieval processes have been more 
appropriate for computer models of learning experimental verbal tasks than for 
explaining retrieval in everyday life. In the models, retrieval, and thus 
thought, become an action of pure intellect across a highly restricted domain, 
an action that confonus to the rules of logic. Stroncjely, Henle (19G2) even 
argued chat when a person commits a logical error, \ho is still thinking 
logically- Itu' error ar\ses frm changes in the material from which reasoning 
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proceeds. As Estes (1975) insisted, there is more to the brain than cortex. 
Other parts evolved earlier and are just as iifiportant in behavior in modern 
man as they were to his ancestors (see also Evans, 1980). For motor skills 
especially,- -the roles of lower brain systems in LTM should not be ign-^red. 
The rhythm and harmonics o^ coordinated actions emphasized in Section IV are 
not matters of logic. Earthwomis have bot t rhythm and harmonics. 

The second point of the reductio ad absurdum was to emphasize the need to 
focus on the selective processes of retrieval . TraJi tional ly , successful 
selection was equated to ii>emory as sheer retention, so interest went no 
further than identifying factors (sets, vividness, amount of practice, etc.) 
that affected response production such as verbal recall. Tapping the contri- 
butions of cognitive science, a aistlnction should be made between long-term 
retention qua retention and response production. Sel ection, an executive 
function, Is itself an Important consideration in training. Response systems 
in LTM are of no value to operators if they cannot access them as needed, when 
needed, and without disruptive interference. , 

As with other topics, the present purpose is to identify components of 
skills to consider in designing and using training equipment, not to explore 
their rami f i cati ons and details of their utilization. It would be well to 
mention, however, that there are some fonnulations of selective processes that 
reveal what a trainee should learn. Greeno (1978£), for example^ discussed 
means-end analyses, constructive searches, transformations, and other execu- 
tive processes in a way that identifies particular capabilities trainees 
should acquire. Greeno related these processes to three basic types of 
problem solving; but as before, there are clear analogs to problem solving in 
task perfonnance generally, and especially in the learning of tasks. Evans 
(1980), for example, ccnsidei.;d the iT)eans-end analysis oroblem solving 
studied by Newell and Simon (197Z) a valuable heuristic - understanding 
thinki ng i n general . 

MOTIVATION 

Modern cognitive psychology is often criticized for neglecting motiva- 
tion. In one sense this is a valid criticism. In positing purposive behavior 
at the outset, cognitive processes pursuant to goo , s have been the e^nphasis in 
empirical and theoretical research, not the processes whereby goals are 
established and hocome functional. On the other hdno, there is ;Tior». motiva- 
tion in tognitivt^ psychology tnan might meet the eye. A brief historical 
digression will [irovide a bafJs for revealing it. 

The firsc point is that motivation should net be equateiJ to desire, want, 
or even interest. These cogni ti ve-eniotional states may, and as nfton as not 
do, lead to no productive beiiavior whatsoever. Spears and Deose (197)) 
explained how self-concept, to many an all encompassing motivational systefn, 
does not go beyond Aristotle's concept of fonnal cduse» Fonn is essence, and 
matter strives to acquire form. 'irgo. motor, moving, or effectWel cause is 
derivative of fon]i; all that is needed )s the fonn~-the desire or interest. 



As trcur.l ait'.-i, Aristotle refi^rreii to "ef f ic ivTiv.'' rather than "effective" 
cause. "Effective'' is used here because in the context of training, 
"efficient'* does not have the connotation needed. 
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Any motivational concept such as desire or Interest can be substituted 
for self-concept in Spears and Deese's analysis without changing the meaning 
or the cogency of their argument. Their point was that without a more or less 
independent effective cause-^the only recognized causal agent In the physical 
sciences'-there is no way to derive behavior. To be a useful concept, motiva- 
tion has to incorporate di rected actions . A desire or interest cannot affect 
learning and performance unless 1t ts Implemented. 

Woodworth (1918/1970) distinguished between "drive" and "motive" on this 
basis. Motivation is direction. In developing principles of human adjust- 
ment, Shaffer (1936)"^oi ned a growing trend in separating the energy component 
from the directive one, calling the former "drive" and the latte^^ ''motive." 
This type of distinction became the basis for "habit" 1n the behaviorism of 
Hull (1943) and Guthrie (1935). Learned habits, the responses attached to 
stimuli, are directive forces and hence are motives. As Shaffer explained, 
anyone who has formed a habit of reading a newspaper will read newspapers. 
Desire to read no more creates the habit than habit creates the desire. Estes 
(1958) took a similar position in earlier formulations of a stimulus-sampling 
theory of motivation. 

There are serious weaknesses in the S-_R conception of motivation (Bolles, 
1975; Kendler S Kendler. 1975), but the sTTortcomi ngs are not in the concept of 
direction. Rather, they are the assumed mechani sms, plus undue dependence 
on the biological concept of homeostasis. Drives were assumed need states 
arising frofn physiological imbalances; they were complexes of stimuli 
(Guthrie, 1935; Hull, 1951), or in the earlier Hull (1943), sources of drive 
stimuli. But as White (1959) showed clearly, after "its ho'neostatic chores 
are done, [an] organism is alive, active, and up to something" (p. 315). In 
brief, traditional behaviori stic theories of motivation could not account for 
a kitten playing with a spool. 

Accordingly, research in developmental psychology turned to cognitive 
factors as mentioned earlier--an evolutionary based compulsion for competence 
(White, 1959); cognitive dissor.ance (Festlnger, 1957); discrepant cognitive 
organization (Feather, 1971); and Piaget's schematic disequilibrium 
(Tuodenham, 1966). Hunt (1961) held that motivation "inhere(s) in the pro- 
cessing of information itself" (p. 253), which in turn results from means-ends 
experiences throughout life (Hunt, I960). 

In cognitive science, the directive components of behavior become those 
factors that govern pattern matching and response selection and production. 
Therefore, as stated earlier when this topic was discussed, the cognitive 
matrix Itself is the effective cause of responses, and hence of direction, as 
viewed in modern cognitive psychology. Instead of criticizing cognitive 
science for neglecting motivation, perhaps we should focus our concern on its 
ftiilure to come to grips with selection and produ tion. 

Allport (198Ud^) attempted to do so in his response to criticisms 
regardi ng the al leged si ighti ng of motivation. The same coul d be said of 
Harvey and Greer (1980). A similar pcint was made earlier by Bolles (1975) 
and Bower (1975). To appreciate the implications of their argument, one has 
only to peruse the 1980 Nebraska Symposium on Motivation (Howe & Flowers, 
1981). 
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This Is not to say that modern cognitive theory treats motivation ade- 
quately. As discussed earlier, one may wish to know the mechanisms of 
response production, especially for responses not tied directly to linguistic 
processes. There is also a general Ignorance concerning ''the affective tinges 
that colour our awareness of _aV[ cognition" (Claxton, 1980, p. 17; emphasis in 
the original). 

But even so, there remains ample substance for a training developer to 
contend with. An obvious example is the need to tap trainees' habitual action 
systems that lesd to constructive responses whatever they might do. A common 
observation 1s that desires and Interests often lead to nothing more than 
talking about a matter. Military routine abets this tendency daily. What is 
needed is a felt dissonance or disequilibrium on the part of trainees that can 
be resolved only by constructive action—and being sure trainees have the 
skills to take the action without undue difficulty and discomfort (see discus- 
sion of need for professionalism by Caro et al., 1981). Training devices, 
especially those of low fidelity, pose a problem in this respect because of 
negative attitudes that often develop toward them. Attitudes are potent moti- 
vational systems, and negative attitudes are accompanied by a host of general- 
ized diversionary, nonconstructive response systems that especially affect the 
setting of one's performa-ice goals. Negative attitudes can be dealt with, but 
not superficially (see Caro et al., 1981). 

This facet of performance Just mentioned, goal setting, Is 6 crucial con- 
cern in training. It Is treated at some length in Section iV as a cognitive- 
component uf motor skills. What Is said there is completely applicable to 
cognitive skills. Discussion is delayed only because an immediate context of 
goal setting is needed for particular issues in motor performance. 
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SECTION IV 
ANALYSIS OF MOTOR SKILLS 



The purpose of this section is to extend the analyses in Section III to 
cover motor skills, and to examine dimensions of motor behavior that are not 
represented in purely cognitive skills. To avoid undue redundancy, one or 
both of two general criteria, applied rather loosely, governed selection of 
motor dimensions tc discuss. First, their roles and qualitative and/or quan- 
titative characteristics change with practice. Second, their transfer charac- 
teristics merit special attentio.u As with cognitive skills, the emphasis in 
the analysis is on skill characteristics emerging from well controlled, i.e., 
laboratory, research. 

The discussions that follow are grouped under five major heads: 
{1) models of motor skills; (2) motor aspects; (3) perceptual aspects; 
(4) cognitive aspects; and (5) organization of motor skills. Treatment of 
situational aspects such as task demands, time constraints. Interference, 
etc., is integrated into the discussions of the last four major topics. The 
reader will note that the analyses of two of these topics, motor aspects and 
perceptual aspects, apply as presented only to skills that depend on special 
coordination of movement. The last two topics are extensions of material in 
Section III as it applies to all motor skills. 

MODELS OF MOTOR SKILLS 

Models of motor skills are not developed as fully as those for memory and 
cognitive functioning. They lack both the detail and comprehensiveness of 
cognitive models. One reason is they focus on simple movements in clearly 
defined tasks, such as involved in moving the arm a defined distance or 
"aiming" the hand toward a terminal goal. An important exception is tracking 
experiments in which subjects directly or through manipulation of Instruments 
attempt to maintain contact with a moving target. 

Except for problem solving, cognitive models also focus on restricted 
tasks such as those involved in verbal learni ng and memory experimencs. There 
is an important difference, however. When dealing with verbal processes, a 
researcher or theorist is studying a highly generalized discrimination system, 
one so pervasive in complex behavior that it can be said to represent the 
entire significance of being born human. Simple movements and tracking per- 
formance do not have such generality, at least not ostensibly. In fact, the 
common bel1ef--one that is criticized later--is that motor skills are specific 
to particular tasks. They do not generalize except to other tasks that are 
highly similar in physical characteristics. With a restriction such as this, 
motor theories seldom pursue generalization of skills, a shortcoming that 
limits their value in training. 

The limitations are apparent in the following discussions of two types of 
models of motor skills: "channel" models and "process" models. 

CHANNEL MODELS. Channel models could be termed "structural" in the sense the 
term was contrasted with "process" In models of memory discussed In Section 
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III, "Channel" is used here, however, because that is what these models are 
called. There are two basic types, single-channel models and multi-channel 
models. In either case, "channel" denotes a presumed neural network in which 
all Information related to an cctfon is processed. 

Single-channel theories assume therc^ are definite restrictions on the amount 
of information that can be processed ?t one time because all processing must 
occur in a single uni purpose network (Kinsbourne, 1981), If two tasks are to 
be performed concurrently (time-shared), it is necessary to attend each on a 
serial basis, either by completing one before starting the other or through 
successive interruptions of each so that attention can be shifted periodi- 
cally. If a person does two things at once (talking and walking) that require 
paral 1 el , not serial , processing, at least one of the actions must be so 
habitual that it requires no attention. If habituation is the case, then the' 
skill is no longer of interest in single-channel theory because it is no 
longer processed in the channel (Kinsbourne, 1981). Single-channel models 
thus are restricted to skills that require deliberate attention, skills that 
have not been mastered sufficiently to be performed automatically. Yet, these 
models are typically not concerned with skill acquisition. In the majority of 
experiments addressing these (and other motor) theories, data are not even 
collected until subjects have practiced enough for performance to stabilize. 

From a training standpoint, it is necessary to know how a skill develops from 
the beginning. Just as important is the nature of skill habituation and how 
to achieve it. Furthermore, a number of complex skills require attention for 
their several component tasks--controlling the path of an aircraft while 
scanning various instruments and communicating with the ground. In single- 
channel theory, one would have to consider all tasks a single action or else 
insist that no more than one requires attention. Otherwise, there must be 
continual intertask interference, not only when first practicing the integra- 
tion of the tasks as can be expected, but indefinitely. Obviously, toe 
fallacy of affiming the consequent arises when complex skills are at issue. 
If the performer does more than one deliberate thing at a time, they really 
comprise only one action by definition of single-channel processes. 

Multi-channel theories assume at a minimum that capacity to process infor- 
mation can be allocated either to separate channels or to functional divisions 
within one channel (Kinsbourne^ 1981). They recognize time-sharing not only 
of actions but of attention. They also seem more consistent with observed 
patterns of interference among actions, especially patterns arising from same 
veriius different sensory-responding modes (cf. Allport, Antonis, & Reynolds, 
1972i Kantowitz & Knight, 1974, 1976; Kins&ourne, 1981; McLeod, 1977, 1978; 
Posner & Boies, 1971). 

As with the single-channel models, however, multi-channel models at present, 
qua models, do not offer much for training. Their adaptability to training 
1 ssues i s hampered by postul a ted exclusiveness and rigi di ty of channel 
domains. Even the research they have stimulated has been directed more to 
determining the structures and boundaries of channels in the nervous system 
than to what performers do and hov/ they learn to do it* As for the rigidity 
of channel domains, refer to the Section III discussion of multiple versus 
single LTM systems; for a criticism of the misdirected research, see 
discussion in Section III of structures such as "stores" as Aristotelian 
causal forms. 
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PROCESS MODELS. As pointed out early in Section III, "process" has two 
meanings in conceptions of behavior. One use of the term Is generic as in 
"Information processing." This use Includes channel theories. The other use 
of the term is to designate conceptions that focus on processes per se as 
opposed to processing structures. It is the latter use, processes versus 
structures, that applies to process models of motor skills. 

Three types of process models are of interest, plus a fourth orientation that 
has not been systematized sufficiently to be called a model. These are 
"closed-loop" models, "open-loop" models, and "schema" models. The fourth 
type of conception views the nervous system as a dynamic network in whicii pro- 
cesses interact according to the demands of overall a-ijustments to task 
requirements, and to specializations of "regions" of the brain. 

Closed-loop, often called "cybernetic," models of motor perfomance developed 
along with the^re general ideas of cyoernetics as this science applied to 
systems controlrSnd computer design. The essential components of a closed- 
loop system are inputs, outputs, and servomechanisms. In psychological 
models, these components can be defined operationally. Inputs are cues, out- 
puts are responses to them, and servomechanisms represent corrective reactions 
to negative feedback. Given a cue, a person responds according to the charac- 
teristics of the processing loop. All the while, he monitors his actions 
relative to the system by recognizing indicators of desirable and undesirable 
effects on system performance. In the case of undesirable effects, the 
performer's recognition of them comprises neoative feedback which, as an 
additional cue, leads to alterations in responses. 

The value of closed-loop models for training is twofold. First, they parallel 
a variety of behavior. Second, the behavioral concepts--cues, responses, 
feedback— denote phenomena about which we know a great deal. Moreover, 
closed-loop models adapt well to what we know about skill acquisition (see 
later discussions). In fact, Adams (1968, 1971, 1977), a leading proponent of 
closed-loop theory, titled the main formulation of his position, "A Closed- 
loop Theory of Motor Learning" (Adams, 1971). 

The essence of a closed loop is the functioning of regulatory feedback while 
an action is occurring. As stated, many skills have this characteristic. 
However, as an action becomes more and more habitual, the performer is less 
and less sens-^tive to feedback during the action. Furthermore, the lack of 
sensitivity i related to time constraints on performance. Thus, rapid 
actions of short duration (throwing a ball; sudden discrete control inputs; 
etc ) do not appear to fit a closed-loop model because there is not enough 
time to process negative feedback (Hammerton, 1981; Howarth & Beggs, 1981; 
however, see Adams, 1977). Neither do slower, longer actions that have become 
habitual to the point of mechanization, or which incorporate no natural 
provisions for concurrent feedback. 

Open-loop models are designed for actions of these sorts. They require only a 
cue for their initiation and an Integrated set of associated responses. 
Intuitively, it appears that the Integrated cue-response system required in 
open loops must follow a "program." That is, once the cue to initiate an 
action occurs, the action is executed without Internally based Interruption 
just as though it were directed by a computer program that had no error 
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detector or contingent branching.-^ Feedback, in this case knowledge of 
results, can be effective only at the end of an action, and then only for a 
subsequent action. 

As with closed loops, we know quite a bit at the gross behavioral level about 
processes comprising open loops--the development of cue and response discrimi- 
nations and the effects of knowledge of results. In fact, we know more about 
feedback as knowledge of results than as a servomechani sm. Nevertheless, as 
presently formulated, both types of loop models suffer a serious limitation. 
They do not Incorporate generalization processes. That is, in postulating 
single-loop control of a given action, they do not explain how--or even 
whether--a giv^n learned action can be performed in the ever changing contexts 
of real-world situations. In other words, one would have to posit a separate 
loop for each variation in situations, including those not yet encountered. 
Obviously, loop models cannot account for the critical characteristic of skill 
robustness as discussed in Section II. 

Schema models are attempts to surmount this problem. As with cognitive sche- 
mata (Section III), these processing "structures" are inherently generaliza- 
tion systems. Thus they are not substitutes for loop models; rather, they are 
part of the long-tenn memory (Laabs & Simmons, 1981) in which loops fill 
designated roles (Holding, 1981; Newell, 1981; Summers, 1981). In the com- 
puter analogy, they are hierarchical executive systems (Section HI) in which 
master and subordinate programs assess requirements of a situation, scan 
available behavioral resources, and adapt and activate processing units (e.g., 
loops) as needed. Robustness--discriminative general ization--of skills is 
thus dependent on the . structure of schemata. 

We know practically nothing about the development of motor schemata qua motor 
schemata. Schematic motor processing has not been studied directly to 
anywhere near the extent schematic cognitive processes have. It is not even 
clear that they can be as comprehensive as cognitive schemata. General 
beliefs are that they cannot, but common positions on the issue may be due to 
failure to conceive of motor performance in a sufficiently broad framework 
(see later discussion of task specificity of motor skills). At any rate, we 
do have a backlog of data on training motor skills for generalization. And 
because motor performance seems more and more to involve cognitive components 
(schemata are only one example), and to be analogous to cognitive processes, 
there is hope that cognitive research will clarify issues in motor behavior 
(Holding, 1981; Laabs & Simmons, 1981). 

It may also be that conceptions of motor behavior can help clarify issues In 
cognitive performance. As mentioned in Section III, cognitive models tend to 
view people as logic machines, i.e., In tenns of purely rational cortical 
functioning. Estes (1975) and Evans (1980) (and others) emphasized the 



Some writers use "motor provjram" Instead of "open-loop" in referring to 
these types of models. "Motor program" Is more descriptive, for "open-loop" 
is a misnomer In some usages. The behavior designated often does not comprise 
a loop In the sense of a recurring sequence of responses in a single action; 
and the behavior may be "open' only In th-^t negative feedback does not force a 
return to a starting (input) ^.oint to adjust responses. 
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restrictions inherent in such views. We are just as dependent on lower brain 
centers as were the "lower" animals from whom we evolved. What was termed 
earlier a "dynamic" approach to understanding motor performance recognizes 
that behavior derives from integrative processes of the central nervous system 
as a whole. In a generalized sense of Handler's (1962) "functional units" 
(see Models of Memory in Section III), integrations are governed by task 
requirements as constrained, of course, by behavioral characteristics of the 
brain centers involved. In effect, the orientation has much in common with 
popular conceptions of behavior. The brain is an organ of comprehension, so 
skills develop and actions are executed via intelligence guided by experience. 

Recent attempts to reduce the vanueness of such an orientation have focused on 
localization of response systems in the brain. However, except for clinically 
oriented studies icf. Shingledecker, 1981, for example), these attempts have 
centered mostly on the cortex (cf. Kinsbourne, 1981; Nebes, 1974). Some of 
the research is of considerable Tnterest, especially that showing patterns of 
interference among psychomotor processes to be related to the roles of left 
and right hemispheres of the cortex. However, the implications of the find- 
ings seem to be greater for the design of tasks and operational equipment than 
for training once task requirements and equipment characteristics are 
establ ished. 

Finally, there should be mention of numerous attempts to develop processing 
models, mostly minimodels, of a mathematical nature. The earliest, and almost 
only, 'comprehensive models were extrapolations from information theory 
(Gilbert, 1958, 1966; Shannon & Weaver, 1949). This approach received quite a 
bit of attention in psychology (Attneave, 1959; Fitts, 1954; Hick, 1952; 
Hyman, 195;; see Johnson, 1967, for bibliography). It was not particularly 
successful in psychology, however (Howarth & Beggs, 1981), nor in other fields 
for that matter (Bross, 1966). 

On the other hand, minimodels, building on decades of quantitative descrip- 
tions of motor behavior as well as recent work, have developed equational 
formulations that have been quite successful in predicting perfonnance of spe- 
cific skills, especially discrete movements. For present purposes, the value 
of these minimodels is their specification of response components leading to 
errors and sources of inaccuracies in performance. There also have been some 
attempts (e.g., Restle, 1958; Suppes, Macken, & Zanotti, 1978) to formulate 
mathematically the cognitive roles of various factors that are amenable to 
instruction. 

MOTOR ASPECTS 

This discussion addresses response production, structural characteristics 
of movements, and temporal characteristics of movements. 

RESPONSE PRODUCTION. Conditions affecting response production, specifically 
conditions of practice that lead to response stability, have been explored 
extensively for simple skills. However, as explained in Section III, the 
mechanisms whereby responses are selected, adapted, and initiated are still 
largely matters of speculation. Perhaps it is alright in cognitive theories 
to assume that responses energe from the information processing matrix. 
Nevertheless, in motor learning and performance, it seems that the mechanisms 
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of response production should be a concern. Generally, It Is assumed that 
sets are Involved, as Indeed they must be, but the nature of the sets, how 
they come to produce responses, and how response production per se develops 
with practice are largely Ignored. Also, while the Implicit processes are not 
often calle^ such, the sets must incorporate cue and response discriminations 
and generalizations in order for responses to be selected and adapted. It is 
recognized, of course, that selection and adaptation occur in motor perfor- 
mance; but there have been few attempts to examine the nature of these pro- 
cesses. Especial ly lacking is research on long-term development of the 
governing sets and their retention over time. The bulk of the laboratory 
work, and of the theorizing, has been concerned with short- term development 
and memory of (mostly) simple skills. 

Nevertheless, there is one approach to theories of skill performance that 
should help in conceiving of response production In a training setting. 
Specifically, so-called "motor programs" posit the existence of a functional 
neural structure In which cue-response relations are "stored," (See Cognitive 
Aspects this section.) This conception, which Is derived from an analogy to 
computer operations, can be objectionable In that there is no convincing evi- 
dence that physiological processes correspond to those of computers. However, 
"motor program" does have heuristic value; and as Summers (1981) has demon- 
strated, one need not be bound by the restrictive assumptions made by 
individual theorists who built on the computer analogy. We will return to 
this topic later. 

An especially difficult question from the standpoint of motor theory concerns 
the origins of responses. How Is it that an Individual comes to have a 
response to select or initiate prior to learning a cue-response relation? 
Easton (1972) proposed that motor responses are -developed using reflex pat- 
terns as "building blocks," and Hayes and Martenluk (1976) showed that 
reflexes can be chained to form movement patterns that are subject to altera- 
tions through conditioning and the intention! of the performer. This approach 
smacks of the attempts In the nineteenth dnd early twentieth centuries to 
explain all behavior in terms of conditioned reflex systems. (One early 
theorist, J. Loeb, carried the reduction to the level of troplsms. It Is not 
clear that modern theories of neural mechanics are a significant Improvement.) 
Fortimately, the question of the ultimate origins of responses is not of con- 
cern in the present project. Rather, the question is how can v/e design 
training so as to build on common response capabilities already possessed by 
learners, whatever their origins? 

STRUCTURAL CHARACTERISTICS OF MOVEMENTS. Enough work has been done on the 
structural characteristics of movements Involved In skill performance to 
reveal the need to understand them. In his doctoral dissertation In 1899, 
Robert S. Woodworth (cited In Howarth & Beggs, 1981) described three charac- 
teristics of movements that have been a major topic for study to this day. 
Identified as phases of movement, these characteristics are: (1) Initial 
acceleration at the onset of movement; followed by (2) a period of constant 
velocity; and (3) deceleration of movement as a terminal point Is approached. 
The durations of these phases vary with practice and with purpose. For 
example, If the movement Is to terminate at a particular target. It must be 
aimed. Woodv/orth found that when care Is taken during aiming, the initial 
acceleratlve phase is quite brief, and the decelerative phase Is drawn out. 
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Furthennore, during deceleration, feedback is employed to introduce correc- 
tions.!.- On the other hand, unaimed movements (e.g., along a defined distance 
•with no need to hit a target) typically do not show such a marked period of 
deceleration, nor the use of coincident feedback. 

An additional finding by Woodworth (Howarth 4 Beggs, 1981) was that practice, 
at. least under the task conditions used, had little effect on the target 
accuracy of very rap1d_ mOYements but did affect accuracy of slower movements. 
Beggs and\ Howartti (1972) showed that the practice effects on slow movements 
were related to a lengthening of the decelerative phase. That is, subjects 
spent more. time assimilating feedback and correcting errors. (With practice, 
their subjects moved more rapidly during the first, accelerative phase.) 

Woodworth* s findings have held up well over the years (Howarth & Beggs, 1981), 
and there have been several variations on his approach in subsequent experi- 
ments, he variations' wll 1 not be pursued at this time. Rather, this part of 
the dis jssion »^^ll close by highlighting five major aspects of his findings 
as confirmed in subsequent research. Firsts the effects of practice on 
accuracy of movements appear to have been mediated through increased use of 
feedback. Second, the increased use of feedback was made possible by 
perf oncers' own adjustments in the response process whereby feedback cues 
couTd be more readi ly recognized arid asslml 1 ated Vsee later discussion of 
speed-accuracy trade-offs). Third, the differential effects of practice on 
fast versus slow movements appear to have been due to lack of opportunity to 
employ feedback cues for corrections during fast mpvements. Fourth, more 
effective use of feedback during slow movements was possible because it could 
be mediated visua^lly. Fifth, a distinction should be made between systematic 
errors (e.g., the\mean of errors taking algebraic sign into consideration) and 
variable errors (^.g^, the mean of absolute errors). Systematic errors tend 
to be positive (too long a movement) for near targets but negative for far 
targets, while variable errors are monotonical ly related to target distance. 

When considering the implications of these points for training, one must con- 
ceive of skills considerably more complex than the movements studied by 
Woodworth (and most\ others studied in laboratory settings) . "Accuracy'* in 
everyday life typically involves a matrix of criteria, whether or not perfor- 
mance can be evaluated overall according to a particular fulfillment of task 
requirements. Also, one cannot arbitrarily force fast or slow movements. The 
speed of movements is, largely determined by requirements inherent In the tasks 
to be performed and by performers' idiosyncratic adjustments to these' requi re- 
ments (see following subsection). Nevertheless, most skills, Including those 
that require fast movements^ in the early stag.es of acquisition probably func- 
tion as closed-loop control systems in which performers attend one aspect at a 
time a/id attempt to monitor their performance on this aspect while it is in 
progr^jSs. It would be helpful if this natural. If not necessary, inclination 
could</be facilitated by a device that permitted part- task practice of separate 
tempo^fary closed- loop systems, preferably wi th the option of swi tching from 
one p'art-task to another according to progress. "Freezing" selected param- 
eters in a flight simulator serves such a purpose. However, one general 
advajfitage of simulators that perhaps has not been emphasized enough is that 
learners can choose to focus on one component skill at a time without danger 
to themselves or to the equipment. That they do so was evident 1n a recent 
exploratory study (Isley & Spears, 1982; Isley, Spears, Prophet, 4 Corley, 
1982) In which Navy pilots practiced simulated aircraft carrier landings. 
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From computer printouts of percents of time 1n tolerance during landing 
approaches, it was apparent that for the first 16-24 trials the pilots tended 
to concentrate on glldeslope or angle of attack (AOA) or line-up, with the 
particular part- task receivinglElie most attention vary IngTrom trial to trial, 
and even from one segment of the approach to another. In other words, in 
spite of the ostensible r'^ounds for positive, relations among performances on 
these three tasks, Interc rrelations of percents of time in tolerance were as 
often negative as positive earl ier. trial s, becoming predominantly po,sitive 
only after integrations of the tasks began to develop. (See Organizational 
Aspects of Skills for a further discussion of these data.) 

A different sort of analysis of movements wa5 presented by Smith and Smith 
(1966). In a series of studies, they, togethe- with colleagues, found three 
components that are distinguished by their commonality to a variety of move- 
ments, their relative independence of each other, their frequently differing 
rates of acquisition, and their differing transfer characteristics. They 
tenned these components: (1) posture, or the general body attitude relative 
to a task; (?)^ transport, or rate control of movements of limbs involved in an 
act; and (3) manipulation, or contact and positioning movements. Viewing 
skills largely as closed-loop systems. Smith and Smith considered posture 
'^egulated mainly with respect to gravity, transport regulated through neural 
and learned patterns of feedback, and manipulation regulated through stimula- 
tion arising from contact of hands, fingers, ^tc, with the objects being 
manipulated. The manipulative movements depend on preparatory .ransport 
movements, which in turn are supported by the postural base. 

Smith and Smith (1966, p. 414) emphasized that postural and transport move- 
ments -are not greatly affected by practice because, through daily experiences, 
they become highly generalized. Postural movements can introduce interference, 
however, and if so they can be altered with f/ractice (Jones, 1965). As for 
the lack of practice effects on transport. 'movements, compare Woodworth's 
finding that rapid transport movements Were not affected by practice. (It is 
interesting to note^that, except for experiments on t-icking, transport move- 
ments have been the ones most frequently studied.) On the other hand, manipu- 
lative movements, being the most special ized, not only require more practice 
for mastery, they are least likely to generalize or. transfer to a different 
context. 

On the basis of the degrees of generalization and specialization involved, 
these points seem defensible as stated. There is also empirical support for 
them. Hecker, Greene, and Smith (1956) found the predicted differential in 
the effects ot practice on transport (they termed it "travel") and manipula- 
tive movements Involved In a dial-setting task. Smader and Sr tth (JL953) found 
similar differential effects in a p1n-assembly task. Of sTJeci'aT^ note, 
however, is the reduction in the differential found by Hecker et al . /(1956) 
as the transport component required more precise, i.e., discriminative, spa- 
tial positioning of the hands. A similar, but more revealing effect was 
reported by Simon (1956). Using the pin-assembly task of Smader and Smith, 
Simon increased discrimination requirements at various points in the assetnbly 
operation (grasping; loaded transport, i.e., with pin in hand; positioning; 
empty transport). He found that when greater discrimination was required 
within the positioning component, practice had greater effects on both this 
component and the grasping component. With the increased discrimination 
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required in the loaded transport component, this component and the grasping 
component showed increased practice effects. 

Von Trebra (cited in Smith & Smith, 1966, p- 416) demonstrated the complexity 
of the transfer of transport and manipulative components of movements. 
Subjects first practiced a sequence of switching tasks using one of four move- 
ment patterns, and then were tested for transfer on the other three. Not only 
did transfer vary depending on the learning and transfer movement patterns, 
the transfer of transport and manipulative components differed as well, often 
radically. In fact, of the twelve transfer configurations, manipulation had 
positive transfer effects on eleven and negative effects ^ on one, while 
transport had positive effects on r-ly five and negative effects on seven. 

On reflection. Von Trebra' s data are not all that surprising. Differing pat- 
terns of transport movement may be expected to interfere with each other, but 
'not the manipulative movements ( switching because they were esse^ti^l ly the 
same in all tasks. Yet, it is apparent in the data that the magnitude of 
manipulative transfer was differentially affected by movement' patti^rns. In 
other words, an under'standing of transfer require^ insights into the 
coordination of actions. , 

Certain proscriptive impl ications' of this discussion for device training are 
fairly obvious. Task perfommane in a device should not involve directions of 
transport movements that are at odds with those needed for operat^'onal equip- 
ment. As manipulative movements depend on transport induced positions, device 
task performance ^Should not require a coordination of these movements that is 
structurally different from those needed with real equipment. Less obvious is^ 
the implication of a need to provide a means for ongoing monitoring of each, 
component of a movement by the performer, both in the device and probably 
during the early stages of practice with operational equipment. There are 
other implications, probably more profound ones, that cannot be clarified 
until temporal and cognitive aspects of skill perfomance are. examined. The 
same holds for the characteristics of movements identified by Woodworth,* so 
there will be reason to mention these topics again. 

In the discussion of Woodworth's data, reference was made to differences in 
movement patterns when aiming at a target was and was not involved. This dir- 
ference is probably important, and it leads to another way of viewing com- 
ponents of movements. Specifically, aiming and transport (in the sense of 
Smith and Smith) are governed by different internal processes. In Woodworth s 
terminrlogy, aiming governed by vision and trdnsport by a "muscle sense,' 
Furthermore, aiming is corrected during movement by concurrent feedback as a 
servomechanism, but after sufficient practice, transport involves minimum 4jse 
of concurrent feedback. The pirobable imprtance of this difference- lies in 
the 'efff*;cs of practice on these components as discussed earlier, and the 
likely differing conditions that optimize their acquisition. Because of these 
differences, Howarth and Beggs (1981) pointed to the need to measure accuracy 
of aiming and transport (not their term) separately so as to reveal their 
separate contributions to skilled movements. If measured through errors, lack, 
of transport accuracy would be reflected by errors in the direction of^mov^- 
ment, and aiming accuracy by errors orthogonal to the direction of movement. 
These separate r^easures are of interest not on'y for ret>earch purposes, but 
for monitoring and diagnosing sources of difficulty auring train-'ng. 
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TEMPORAL CHARACTERISIICS OF MOVEMENTS, For complex control skills, temporal 
characteristics of motor movements are probably the most basic constderation 
in the conception anc* design of part-task and low-fidelity training devices. 
In various ways, timing of responses is the essence of skill coordination; and 
it is in the timing that interference effects are often most profound. Any 
trainir^ device which, because of its design or manner of use, results In 
inappropriate timing of responses! is likely to produce negative transfer, 
Furtherraor?, if practice in the device progresses to the point that 
inappropriate temporal patterns become well established, the patterns can be 
very difficult to change (Newell, 1981; Summers, 1:^/5) • There is a problem, 
however, in specifying just whac aspects of timing are critical and which are 
not. This section attempts ^ clarification of the problem. 

It is difficult to assess the adequacy of our knowledge regarding temporal 
characteristics of motor skills. Certainly, reaction time and harmonic rela- 
tions among responses are critical to coordinated performance. Reaction times 
have been studied since the earliest days of experimental psychology, and 
there is an abundance of literature on the topic. Yet, Castellan and Restle. 
(1978), in the third volume of their Cognitive Theory , devote roughly half of 
the *pages to Part II which is enti t1 ed, "New Views of Reaction T'ime and 
Accuracy." In their chapter of this book, Pachella, Smith, and Stanovich 
(1978) stated, "with such an ex^tensive effort of cognitive psychologists cen- 
tering around the use of this single variable [reaction time], it has become 
crucial that the variable come under close scrutiny" (p, 169). Pachella et 
al • were referring to the central role of reaction timr as a dependent 
variable in cognitive research (see Section III), Nevertheless, their point 
is even more important to psychologists studying motor skills where reaction 
times are integral to skill perfonnance. It is widely accepted that cognitive 
processes underlie these skills, so reaction tijDes in cue detection, in 
hierarchical processing of cues, in response production which is governed by 
sets, in interpretation of feedback, etc, --all cognitive processes-- 
necessarily govern critical aspects of motor performance. 

Although, as stated, it is difficult to assess the adequacy of our knowledge 
regarding temporal characteristics of skills, we know enough ^bout reaction 
time, harmonic relations, and dynamic components of movements to shed light on 
their roles. The bulk of his subsection will be devoted to these topics. 
Harmonic relations will be discussed first because part of the significance of 
reaction times is their Incorporation into harmonic rhythms. 

Hannonic Patterns , Harmonic relations among movements characterize a wide 
variety of motor skills (Summers, 1981). Although these rhythmic processes as 
such have not oeen the object of much study, their existence is easily 
inferred from interference :effects that result when conflicting harmonic pat- 
terns are imposed on behavior. For example, Klapp (1979) found that subjects 
could not rhythmically press separate telegraph keys at the same time with the 
right and left hands unless the two periods were either the same or one was an 
integral multiple of the other. Klapp and Greim (1979) found that for certain 
classes of movements movements could not even be executed at the same 

time if they differe i duration. Summers (1975, 1981) found substantial 
negative transfer cffe^^^s when subjects learned a task with one inherent har- 
monic pattern a.»d then changed to another s^mil ar task wi th a different 
i nherent harmonic pattern. In reviewi ng these and other studies, Newell 
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(1981) Observed that harmonic patterns in skills can be difficult to acquire 
and difficult to eliminate. Instead of changing harmonic patterns when 
integrating movements of di^ffering harmonics, learners are more Hkely to 
establish higher Order harmonics with which the separate harmonica are con- 
sonant. For example, concurrent dual sequences of responses, oi^e with a 
period of three time units and the other of four, v/ould likely be integrated 
into a pattern of 12 time units' duration. Considerable effort can be 
involved in such integrations- ^ 

Research in this area 1s skimpy, especially as it may apply to military 
training, but perhaps enough has been said to show why harmonic relations 
among skill components cannot he ignored if one wishes to understand motor 
skills and their development. The discussion that follows regarding reaction 
time adds support for this statement. 

Reaction Time . The role of reaction time in motor skills is evident from an 
examination of the complexity of time consuming processes Involved in perfor- 
mance. (It also becomes clear why Pachella [1974] cautioned against the 
traditional over-simplified view of reaction time.) First, we recognize that 
there are time constraints on responses. They can be too early, but undue 
delay Is the greater training problem. Within the time constraints, a cue 
must be detected; processing must be initiated, including discriminations of 
unique cue characteristics and generalizations appropriate to the context; a 
"memory search" must ensue to V'elate the resulting cue Information to 
appropriate processing of reactions; a response must be selected and ini- 
tiated. Once begun, the response must be monitored and adjusted or corrected 
as conditions and purposes require, which calls for detections of feedback 
cues and ^hen repetitions of the entire process. \ 

Every step of this process' has Its own reaction time, and overall reaction^ 
time ^or, an action is governed by these delays plus the time required to 
complete each step. For complex actions Involving interdependent simultaneous: 
skills, new temporal dimensions are introduced related to the coordination of 
reaction times. And the point to remember is that rhythm and timing are based; 
Oh internal schedules, not response onset (Shaffer, 1982). 

P^rhap^ it is already apparent that training, among other specific objectives, 
should target schemata--l earn1 ng sets in the long haul--those ubiquitous 
states whereby each step in the process becomes predetermined and free from 
1 nlterference. The steps must be habituated to the point that each one, 
dliscrlminations and all, are automatic, and just ak automatically, inappro- 
priate alternative reactions never arisel Apparent or not, 1t would be well 
toj Illustrate a few aspects of reaction time sc as to emphasize what is 
involved in establishing the necessary sets. 

Wei beg:n with an assertion and then justify it. Certain measures of reaction 
times reveal important differences between expert and novice performers. 

Considering gross, i.e., total response, reaction time first, it is well known 
th^t mean reaction time becomes reduced with practice. It is not so well 
kn'bwn, or if so not adequately appreciated (Rabbitt^ 19ol ) , that practice has 
perhapslmore profound effects on the vdri ability of reaction times. That is, 
reiaction times from trial to trial become more similar with practice, thus 
resulting in more consistent performance. In complex skills, for which 
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performers typically develop idiosyncratic harmonic patterns, the reduction in 
variance of reaction times may well be more critical than rapidity per se. 
No hamonic pattern can be maintained otherwise . This is one reason expert 
performance 1S characterized by consistent quality. A novice pilot can per- 
form a maneuver in an airplane with near perfection on occasion; an expert 
hardly ever performs it any other way. The expert's consistency would not be 
possible unless his reactions to controls had consistent timing* In turn, 
consistent gross reaction times imply consistently timed automatic processing 
of information through the steps outlined above. 

This leads to an important cognitive aspect of response timing. In simple 
tasks at least, reaction times for erroneous responses are usually more rapid 
than for accurate responses (Rabbi tt, 1981). If learners are provided suf- 
ficient feedback regarding accuracy, they generally reach a point at which 
speed-accuracy trade-offs are at a near optimum as perceived by the learner 
(Kinsbourne, 1981; Link, 1978; Pachella et al., 1978; Rabbitt, 1981; for 
ma wematical analyses: Townsend & Ashby, 1978; Beird & Noma, 1978, especially 
Ch. 8). That is, they slow down enough to check discriminations, monitor 
actions, etc., to the extent they can achieve an acceptable level of accuracy 
while maintaining acceptable spcjd. Though admittedly speculative, it is not 
unreasonable to expect that harmonic patterns originate in these trade-offs, 
at least partly. If so, speed-accuracy trade-offs habituated in a training 
de-ice would underlie harmonics of response patterns that would be trans- 
ferred, for better or for worse, to operational equipment. (Klapp and Greim 
[1979] might prefer to say that harmonic relations establish reaction times. 
The preference here is for the priority of speed-accuracy trade-offs.) 

Howarth and Beggs (1981) reviewed a group of studies that show aiiother rela- 
tion between reaction time and accuracy of responses. Because of the require- 
ments of the mathematical analyses and formulations with which they were 
dealing, they fOirused on "corrective" reaction time, or that involved in 
responding to (usually visual) feedback cues Indicating errors In movements* 
Generally speaking, the closer to a target ai corrective response occurs, the 
more accurate the movement to the target. The faster the detection of and 
reaction to erroneous aiming, the closer to the target a corrective response 
can be made. Similarly, the slower the movement, the closer to the goal 
errors can be detected and corrected. Hence the lengthening of the final, 
deceleration phase of the movement that occurs with practice and the Increased 
use of feedback (see earlier discussion of structural characteristics of 
movements) . 

Again, there are speed-accuracy trade-offs, with reaction times to feedback 
cues and of response Initiation two central factors. And temporal patterning 
should result. Overall speed Is limited by the durat^o the deceleration 
phase, which In turn must be sufficient in duration for e < stable accuracy of 
performance, which In turn depends on how rapidly error cues can be detected, 
processed, and corrective responses made. No wonder harmonic patterns in 
responses tend to be 1d1osync<^at1c. Learners have to organize their reactions 
according to their own tim1r/g capabiVties which depend not only on structural 
neural factors but on Inera'licable process'ng habits (learning sets) acquired 
over a lifetime. And one governor of the temporal pattern, of the hanmonics 
one eventually makes habitual , is t,ie performer' s willingness to err— the 
speed-accuracy trade-off! 
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As can be seen, the sets alluded to by theorists to explain cue detection, 
information processing, and response selection and proauction are highly 
complex and idiosyncratic. It is also apparent that magnitudes and variabil- 
ities of delays in responding to error conditions can reveal not only achieve- 
ment levels but the progressive effects of practice. Measures of these kinds 
would be valuable for research as well as Tor i.ionitoring training. Further- 
more, computers controlling tracing devices could be easily programmed to 
provide the measures. 

Dyn amic components . The three sequential components of movements described by 
Woodworth, initial acceleration, followed by constant velocity, and then final 
deceleration as a terminal point is reached, all aro dynamic concepts. That 
is, they refer to characteristics of motion us a function of time. They were 
discussed as structural components, however, because the emphasis of so much 
of the work done on them has focused not on the dynamic properties but on the 
duration of the components and events related to them--for example, the 
lengthening of the deceleration component and the corresponding increase in 
utilization of feedback. The concern of the studies discussed above was not 
the quantitative Jynamic characteristics of these components, the rate of 
acceleration, the rate of constant motion, the rate of deceleration. 

These quantities themselves can be of interest, as well as at least one other, 
the force of a movement. The reason Is the evidence that these dynamic 
characteri sties have transfer properties that differ from those of the struc- 
tural characteristics. (As the classic work in 1915 by Thompson [1956] 
showed, dynamic characteristics also prescribe limits for actions.) For 
example, positive transfer of dynamic characteristics rommonly occurs when 
performance must be "compressed" into a shorter distance or time interval, 
even though quantitative measures of acceleration, velocity, and deceleration 
must change. (There are excellent illustrations of such positive transfer 
Involving compressed distances In training with low-fidelity devices--e.g. , 
Cox, Wood, Boren, & Thorne, 1965.) On the other hand, forced changes in the 
structural characteristics of movements often lead to negative transfer in 
movement patterns as discussed earlier (Smith & Smith, 1966, p. 416). 

Newell (1981) addressed these differences briefly, usir, a different termi- 
nology. (He referred to "metrical" Instead of "dynamic" characteristics.) It 
is not clear which term is preferable, nor even thut they distinguish the same 
properties of movements. 

Effects o f Situational Factors . To a great extent, temporal patterns in skill 
execution are driven by time-related factors external to the perfonmer--time 
constraints on task performances sensitivity of equipment to "inputs^ stability 
of the equipment (e.g., an aircraft) In the operational environment, time of 
availability of externally ari si ng feedback, etc. Generally, temporal pat- 
terning of actions will adapt, with practice, to these various Influences. 
From the standpoint of device training, timing oi external feedback Is a 
problem primarily for closed-loop skills^ and then only when delays in feed- 
back result in the development of Inappropriate rhythmic patterns such as, for 
example, the jerky, uncoordinated movements reported by Smith (15C2) resulting 
from delayed visual feedback. A similar effect ii* the prolongec* repetitious 
enunciations of syllables when auditory feedback of one's own vo':e is delayed 
(Yates, 1963). Also, it Is well known in the training community that undue 
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transport delays in simulator platform movements or visual scenes result in 
"overrontrol" patterns of responses. Corrective responses are made during 
monitorinq of an action, but because of delays in feedback, corrections are 
maintained too long. The result well may be a pattern of sine-wave harmonic 
corrections-recorrections "more exaggerated than necessary. Recall that once 
learned, harmonic patterns are difficult to eliminate, and patterns of 
differing harmonics produce interference. 

Even so, realistic delays characteristic of actual equipment, when of suf- 
ficient duration--less than a second for some movements— have been founC to 
result In errors. Howarth and Beggs (1981) viewed this problem as a loss of 
position ^or initiating a movement (see earlier discussion of Smith and Smith, 
1966)- at any rate, the value of a "remembered" position has been demonstrated 
by Kincnla and Smyzer (1967) for visually mediated memory and by Adams and 
Dijksi-ra (1966) and Pepper and Herman (1970) for that mediated through 
kinesthesis. Smith and Smith (1966, p. 373) would also emphasize that the 
spatia l patterning of responses changes with delays in feedback. It follows 
that initial and periodic positions of body and limbs per se, as preparatory 
sets, can be factors to account for in the design of training equipment, 
especially the patterning of successive positions in sequential movements. 

Two other situational factors listed above, sensitivity of equipment to inputs 
and operational stability of equipment, are special cases of time constraints 
on performance. A major effect of time constraints has already been 
discussed. They help determine the speed-accuracy trade-offs made by perfor- 
mers, and thus reaction times. In addition, they must affect the development 
of harmonic patterns, although the nature of the latter effect is not clear. 
For example, the relative timing of control adjustments in stable and unstable 
aircraft could well be constant for a given pilot, even though total durations 
of a complete pattern of inputs differ. The issue is skill robustness in the 
descriptive sensp; the central question, however, is the nature of the robust- 
ness Do pilots adapt the relative timing of response components, resulting 
in different basic harmonics, or do they retain the internal relations among 
components and expand or compress the total duration as control maintenance 
requires? The answers to this question have implications for the design and 
use of part-task devices where only a portion of the response components are 
represented and for low-fidelity devices whose functional characteristics 
might impose time constraints that differ from those found in operational 
equipment. If device training results in harmonic patterns whose relative 
timing of components is inappropriate, negative transfer could be expected. 
As stated, positive transfer would be likely if only durations of intact 
patterns vary, i.e., only ^'compression" is necessary. 

PERCEPTUAL ASPECTS 

Perception, the process of giving meanings to sensations, is inherently 
cognitive in nature. Thus, discussion of perceptual aspects of skills sepa- 
rately from their cognitive aspects entails quite arbitrary distinctions 
between these domains. For present purposes, the distinction amounts to this: 
a skilled performer must recognise the conditions and need for an action, 
identify sicinals indicative of specific actions, and produce the actions and 
monitor the' results. By "perceptual aspects" is meant those processes 
involvA'd in signal identificatio n, both prior to action initiation and during 
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monitoring. Excluded from immediate interest are ^he host of processes that 
comprise cueing properties for signals, subsequent "memory searches," and 
response produc ti on . 

This section discusses three topics in this regard: (1) discrimination of 
signals: (2) general izati on of signal discriminations; and (3) roles of 
senr^'^y modes. 

DISCRIMINATION OF SinNALS. For present purposes, the importance of signal 
discrimination is two-fold: the process develops according to fairly well 
understood principles of discrimination learning; and the status of signal 
discriminations "is amenable to measurement. 

It is not necessary at this time t^ examine principles of discrimination 
learning applicable to perceptual sk1l ■ These principles will be drawn upon 
at length when training implications skill analyses are developed. It 
should be pointed out, however, that the complexities of military skills po 
a challenge in the adaptations of these principles to military training. 
Fortunately, it is a challenge that well designed training devices can m^et 
once we know how to zero in on the discriminations involved. 

The importance of the second topic just mentioned, the amenability of signal 
discriminations to measurement, rests in the need to zero in on the discrimi- 
nations. Within the fo»inul ations of statistical decision theory and signal 
detection theory, quantitative estimates of "di'.tances" of signals from 
"noise," or among different signals, can be derived independently of other 
cognitive processes such as interpretations of signals and resulting 
responses. FiTthennore,^ through computerized monitoring of ongoing skill per- 
formancp, tnese estimates should be obtainable during perfonmance of realistic 
skill comuleres in training devices. There is no need to resort to t:\\di- 
tional psychophysical techni^jes which, as a rule, would require artificial 
simplified contexts for measuring discriminations. (In addition, while 
'^easurino ( ^ scriminations, statistical decision theory and signal detection 
..heory po^v t the quantification of certain classes of cognitive processes. 
For SGir.o research purposes, and for diagnoses of learning difficulties, these 
separf^^-e kinds of data can be important,) Then, there are a host of tech- 
niques for scaling di scrimi nat • ons which can be quite valuable at least for 
re-;earch purposes. Whether as dependent or independent variables, 
discriminations can thereby be related more specifically to other variabiles. 

There are a number of excellent reviews of statistical decision theory, signal 
detection theory, and related scaling techniques. In addition to the general 
reviews presented in their books, for example, Baird and Noma (1978) and 
Castellan and Restle (1978) l^st num/,/ous references to intensive reviews of 
the several aspects of these to^^i-r. 

A worthy research effort wou to fonmulate uses of these quantitative 

techniques in a way, dr.d wi \r j context, thct makes them applicable to 
device training and research. V^e offort should include a review of research 
in which the assun:i> ' ';or: of an ''ideal obsei ver" Is evaluated. Both statistical 
decision theory 3.. « signal detection theory postulate certain unrealistic 
characteristics : " . se wh discriminate signals. Fortunately, accumulated 
evidence shows luc . ^ Ne dSS<-mpt1ons need not be as restrictive as convenient 
, mathematical derivation of the theories gsflu^red. 
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GENERALIZATION OF SIGNAL DISCRIMINATIONS. There are so-called "closed skills" 
(Poulton, 1957) that can be performed under relatively invariant conditions, 
and "open skills" (Pew, 1974) which require continuing adaptations to changing 
conditions, either from one occc^ion to anothc or during a single occasion. 
(Closed and open skills should not be conf «;x?d with closed and open loops.) 
Except for interference effects during trair .ng and retention, generalization 
is not a significant problem ror closed skills. It is, however, for open 
skills where robustness is nece >rr;. Therefore, it would be well to discuss 
generalization of signal discri :..na1 ions within a context where robustness is 
critical. The utilization of feedback during skill performance provides such 
a context, so we begin by reviewing a few points concerning feedback. 

Keele (cited in Summers, 1981) identified four functions for feedback during 
skill performance. First, it provides information regarding certain initial 
conditions (e.g., adequacy of preparatory body positions and movements). 
Second, it is the means for progressive monitoring of performance, for ascer- 
taining whether or not perfonmance is within tolerance. Third, feedback is 
the basis for "fine tuning" of skills according to the particular conditions 
for their performance. These fine adjustments may be indicated at the ini- 
tiation of an action as well as regularly throughout the action. Fourth, 
feedback determines the course of subsequent development of a skill. 

With due precautions regarding the reification in the analogy, the notion of a 
feedback "template" (Keele, 1973; Keele & Summers, 1976) is a good way to view 
generalizations of signal discriminations. To adapt these discriminations, 
the performer should have a "criterion template" with which he can compare 
feedback signals, thereby identifying feedback that is, and is not, consonant 
with indications of proper performance. The template requires adaptation to 
the actual conditions of perfonmance, which for a novice should entail delib- 
erate analysis of what feedback should look, sound, or feel like for par- 
ticular conditions. With practice under sufficiently varied conditions, the 
analyses and adaptations would normally become largely automatic. 

As reviewed by Keele and Summers (1976), there is considerable evidence that 
skilled performers act as though they use feedback templates. Bower (1975) 
considered perception general ly a predictive or anticipatory set. That is, 
consciously or not, performers expect feedback to occur in specific forms and 
patterns, and adjust actions accordingly. From a training standpoint, stu- 
dents should be taught the sets comprised of such expectancies. They should 
learn to predict "what happens when," and to recognize when they are correct 
and when they are not. With conscious predictions specifically targeted as 
interim objectives, and given realistic variations of circumstances (including 
specific types of equipment) for performance during training, learners would 
be forced to practice generalizations of the discriminations involved, and to 
the point that the corresponding anticipatory sets became automatic according 
to particular respon:.e strategies (Schmidt, 1968). 

For many skills, it is important that the expectancies and the derived behav- 
ior become rapid and automatic. This can require complex processing. The 
reaction time to kinesthetic feedback is generally thought to be of the order 
of 100msec (Glencross, 1977) and the time between successive movements for 
some skills is of the same order, if not briefer. How does ai operator react 
rapidly enough for smooth performance? One seems forced to the conclusion 
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that expectancies rega-^ding feedback patterns Jor such skills relate to 
overall, idiosyncratic harmonic patterns of skill "units" defined by the indi- 
vidual perfonner. He seeks, in other words, patterns of feedback units to 
correspond to patterned units of movement. If so. he probably learns to key 
on certain components of both feedback and movement patterns, the Infonriation 
from which can be assimilated in the time available Although they stated it 
somewhat differently, this hypothesis was proposed by Adamsl (1968) and 
Schmidt (1971^ If valid. 1t 1s one way to account for the obvious fact that 
feedback functions in some manner even during very rapid actions (Glencross. 
:i977; Summers. 1981). 

ROLTS OF SENSORY MODES Several references have been made to roles of sensory 
modes in motor perfo^ance. and other roles can be readily Inferred from 
discussions. In Smith and Smith's (1966) analysis of movements, for example, 
the postural component of movements is oriented to gravity which involves 
vestibular sensations. (It can be added that initially, v-sion and often tac- 
tile sensations are also bases for postural orientation.) Transport movements 
^re auided visually and ki nesthetical ly . Manipulative movements invo;ve tac- 
tile senses, and often vision. Hamonic patterns of movements require 
proprioception, especially kinesthesis. with regular feedback of a tactile 
nature. 

A detailed knowledge of these roles is probably not needed for present pur- 
noses. Rather, in line with the criteria stated earlier for selecting topics 
?o discuss in' this section, the primary interest is how '•oles develop a d 
change with practice, and the transfer characteristics of different sensory 
modes. 

As for the development of roles, the earlier discussion of what is involved i,- 
acquiring signal discriminations is relevant, as well as the ana.ysis ot cue 
development in Section II. 

Changes in Roles. Changes in roles of sensory modes warrant a 1|ttje more 
comment at this t ime. As skills develop, the util ization of feedback to moni- 
t^ perfonnance often changes. In many cases, a change in the sensory nature 
nf the feedback occurs as well. For example, most transport movements of 
? mbs and m?n1pulat e movements of hands and fingers are guided visually in 
the early stages of skill acquisition. Later, kinesthetic and tactile senses 
take over. A question of import for the design of training devices is how can 
provisions be made for visual monitoring early in ^^^^^^^^S^^^hat would most 
effectively ensure the eventual utilization of kinesthetic and tactile 
f4dback? Stated more generally, how can devices be deigned to provide feed- 
back so that what is learned via one sensory mode aids in the process oi 
learning to use other sensory modes for the same purpose? More on this a 
little later. 

A r( ated issue is especially pertinent to the use of low-fidelity training 
devices. Suppose that because of lack of dynamic fidelity, learners must 



^However. Adams (1977). holding out for a closed-loop model even for 
rapid actions, reviewed evidence that reaction times as brief as 10msec might 
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depend on visual cueing, including feedback, for responses that eventually 
should depend on proprioception. How long can a learner practice with the 
device without coming to depend unduly on the artificial cueing? To the 
extent that artificial cues function as augmented feedback, there is evidence 
that performance can become dependent on the augmentation* and U so the 
effects of practice might dissipate when 1t is withdrawn. On the other hand, 
when augmented feedback is closely related to natural feedback such as would 
be the case when res 1 stance of a control to di spl acement is increased, the 
augmented feedback can enhance both timing and anticipatory components of sets 
that govern performance (Gl enc»^oss, 1977) . Furthermore, artificial cueing 
could be viewed in terms of cue distortions, as would be the case with low- 
fidelity cueing 1n general. What is the effect of distorted cues, especially 
feedback, on Vearni hg , perfonmance, and transfer of movements? Smith and 
Smith (1966) reported a complex study in which directions of star-tracking 
movements were varied as well as the visual orientation of feedback. They 
stated, "When we realize that more than eighty significantly different perfor- 
mances were induced by thirty-two combinations of visual orientation ,d move- 
ment direction, we begin to appreciate the countless possibilities for 
Specific sp-a[ce-structured sensory-feedback interactions that might exist under 
ord^nary conditions of behavior" (p. 419). Smith and Smith went on to review 
stucies of effects of visual distortions ranging from vertical inversions to 
lateral displacements. As is well known, subjects usually adapt to these 
distortions. They also may retain the adaptations with little or no decrement 
for at least two years without intervening practice (Snyder & Snyder, 1957). 
However, Smith and Smith (19*6, p. 421) believed that learning occurring under 
the conditions of distortion is specific to the motions and feedback 
conditions involved. We will soon return to this topic. 

This discussion could be expanded by exploring effects of distortions of 
cueing through other sensory modalities, especially kinesthesis. Howeyer, it 
is more pertinent to present purposes to point out possible resolutions of the 
difficulties that can be involved in cue distortions. First, during training 
it may at times be better to provide cueing through an entirely different sen- 
sory mode than to resort to distortions in the actual modality normally used, 
for example, an aural cue for approaches to operational limits of equipment 
rather than unrealistic changes in instruments that are interpreted visually. 
A second way to-resolve the difficulties would have a moregeneral value. In 
Section II, emphasis was placed on the topological characteristics of cues, 
such as apparent convergence of parallel lines at a distance, as opposed to 
realistic representations of highways, power lines, etc., that can show con- 
vergence. In this light, the depth cues provided by simulated checkerboard 
ground scenes are not necessarily distortions of reality at all. What we need 
is a comprehensive analysis of topological characteristics of cues, at least 
for those provided through vi sion, kinesthesis, and perceptions of acceleran 
tion. The question then would be, how much distortion in topological charac- 
teristics can be tolerated? The answer may well be, "not much." ( Cf . earlier 
reference to effects of transport lags on temporal patterns of responses, and 
on the nature of the movements themselves.) This answer may pose no problems 
for many purposes, however. As with the checkerboard, critical topological 
properties may be comparatively eesy to represent without distortion. 

Intersensor> Transfer . Reference was made earlier to intersensory transfer as 
a process of learning. Specifically, cues from one modality such as vision 
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can guide the learning of cues related to other sensory processes such as 
kinesthesis. Phenoiriena of this sort are observed regularly during training, 
and they are surely involved in some of the changes in movement patterns as 
discussed under motor aspects of skills. 

Intersensory transfer has profound effects ^n behavior, and it would be well 
to view 1t in a broad perspective. In 1703 the twenty- four-year-old George 
Berkeley, later Bishop Berkeley, published "An Essay Ti. /ard A New Theory of 
Vision" (Berkeley, 1948). The purpose vvas to show how vision develops spatial 
properties by associating retinal images with sensations of muscular move- 
ments. This paper became a cornerstone of modern empirical associatloni sm. 
While there are disagreements as to the primacy of ki nesthesi s--some would say 
that visual space lends cognitive spatial properties to movements--numerous 
studies have confirmed the essential thesis that infonmation from one sensory 
mode affects the devel opment of 1 nterpre tat ions of i nfonnation from others 
(e.g., Gesell, Ilg, & BulUs, 1949; Rock & Victor, 1964; Rock & Harris, 1967; 
Hein, Vital-Dur nd, Salinger, & Diamond, 1979). 

This broad perspective can help avoid misleading interpretations of some 
aspects of intersensory transfer as it has been studied in skill performance. 
Specifically, it keeps 1 ire- 1 orig learning sets in the forefront when con- 
sidering what are ostensiD ly highly si tuatlon-speci f ic Instances of Inter- 
sensory transfer. As explained below, it also helps account for certain 
empirical data that appear to be without explanation as currently viewed in 
skill learning. 

Studies of adjustnents to distorted visual feedback, discussed earlier, are a 
case In point. It was found. that subjects can adapt quickly to lenses that 
give visual inversions or left-right reversals (see review of studies by Smith 
and Smith, 1966, p. 419£); that these adjustments are retained without decre- 
ment for at least two >ears (Snyder & Snyder, 1957); and that they depend on 
the subjects' associating movements with the visual feedback involved (Smith & 
Smith, 1966, p. 421). We add two other points. First, it has been clearly 
established in these studies that subjects can readjust to nonr.al visual feed- 
back very quickly. The significance of this point seems to have been over- 
Iroked; it should not be when considering the value of 1 ow-fldel 1ty training 
devices, because negative transfer due to a poor visual simulation ioay well he 
only transitory. Second, In contrast to earlier beliefs, Snyder and Snyder's 
(1957) results showed that a subject can switch back and forth between dis- 
torted and normal visual fields without affecting the adjustment to either. 
This phenomenon should have been obvious to anyone experienced with a micro- 
scope, but it was thought that a subject had to wear the di storting lenses all 
the time to adjust tc them. At most, differences between visual (and perhaps 
other sensory) characteristics of devices and actual equipment would probably 
have only temporary effects on performance with either type of equipment. 

These phenomena can be possible only if derived from highly generalized, 
highly discriminative, transfer system-^ And their empirical characteristics 
are precisely those of learning sets. 

A related aspect of intersensory transfer that has been stuoied in skill per- 
formance 1s termed Vecal ibration" (riowarth & Beggs, 1981). This, too. Is a 
process whereby cues from more than one sensory source interact to affect the 
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Informational content of one or more of the other cues. As the term Implies, 
subjects appear to adjust the metric of one (cr more) sensory modes so as to 
gain consonance among originally disparate infonmation from multiple modes. 
Studies of recal ibration have found the process to be quite rapid, situation- 
specific, and dependent on active movements. In addition, certain que5;tions 
regarding transfer of positional irovements were raised. Howartii and Beggs 
(1981) discuss these questions, and the transfer difficulties appear to be due 
to forcing highly situation-specific recal ibration. If this is the only 
problem, 1t need not concern us. 

As with other topics discussed in this section, this is not the place (nor 
time) to explore the ramifications of intersensory transfer for device 
training. Suffice it to say that the foregoing discussion focused on robust- 
ness of cueing processes, a necessary component of skill robustness; and that 
by capitalizing on related life-long learning sets in students, part-task and 
low-fidelity training devices can utilize existing complex discrimination 
systems to promote skill robustness while ensuring transfer of device training ^ 
in cue processing to operational equipment. However, it should be apparent 
that transfer, will not generally be observed on the e^ '.est trials with 
actual equipment If there is much diffcre. ^ in overall cue patterns. One 
should expect adjustments to the new (operational) patterns first. At least, 
the adjustments should be rapid with a minimum of residual interference, 
whether going from a device to actual equipment or vice versa. Minimal inter- 
ference is one blessing of the specificity of the adjustments to specific cue 
patterns. It is important, of course, that habitual processes of intersensory 
transfer be tapped, and that conflicts with habitual processes be avoided. 

COGNITIVE ASPECTS 

Although; they frequently alluded to cognitive processes, the preceding 
discussions in this section focused on more or less mechanical, reactive 
aspects of skill performance. Within tradi ti onal S-R theory in psychology, 
the analysis of motor skills could well end at tlifs point. According to 
modern thinking, to stop here would be to ignore one of the most important 
aspects of skill performance. In citiriy the position of C. Kelley in his 1968 
book. Manual and Automatic Control, Moray (1981) stated, "Kelley argues force- 
ful ly THaTThF'who^ and all behavior associated with it is not 
to compensate for the present state of affairs, for present or past error, but 
is directed towards control of the future state of the system" (p. 32). This 
statement implies that the perfonner has a goal, i.e., the future state of the 
system, and that he can organize his behavior so that the goal can be achieved 
within the constraints of the system. In brief, behavior is purposive, and it 
involves comprehension pursuant to the purpose. 

In these regards, two functions of cognitive processes are discussec, 
establishment of strategies and execution of actions. A third, verba! 
formulations, are often -mentioopd, but the reader is referred to Section III 
for a fuller discussion of language in information processing. Facets of the 
topics below have already been discussed in this section and in Section III, 
so the treatments that follow are sometimes brief. 

ESTABLISHMENT OF STRATEGIES. This subsection addresses three topics: (1) 
goals and standards of performance; (2) planning perfonmance; and (3) 
information processing strategies. 
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Goals and Standards for Per formance . A strategy imolies a purpose, wmch in 
tiIFrTn?pn??^gTa-TT-l^ils for skill performance in the military are set 
forth in t-aining and operational manuals. However, it is not often 
recognized, at least formally, that there are idiosyncratic facets to goals, 
esoeciallv as related to standards for performance, that are not covered in 
official statements. Speed-accuracy trade-offs, which have already been 
dis'ussed are one su ' facet, and apparently an important one. A related 
facet which we simply dub "facilitation trade-off." an idea close to the 
"utility consideration" of f^avon ana Gopher (1979), is often a topic of 
discussion among tne -writer and his colleagues. We have noticed on severa 
occasions that thoroughly experienced pilots can have trouble during formal 
evaluations meetings, "oecific official performance criteria for various 
maneuvers even if they have been performing the maneuvers regularly for a 
lonq time* Often viewed as a problem of retention, it would sometimes be more 
aooroDriate to corsider these difficulties as imposed by the criteria them- 
selves It is not that the pilots cannot perform the maneuvers, and 
skillfully rather, during long hours of self-guided performance they have 
developed 'cheir own f^tandards for how the maneuver should occur. There is a 
difference between tl... nature of performance deviations on thoroughly prac- 
ticed maneuvers and discrepancies on those that have been performed only 
rarely The latter maneuvers show. true, often dangerous loss in ability to 
achieve the purpose of the maneuvers; the fonner reflect purposive departures 
from official criteria, departures that may be as-^-afe as the standards. LrL- 
making these departures, the performer has simply facilitated idiosyncratic 
performance. 

This is not to justify the idiosyncratic aspects in such an instance. There 
are good reasons tor " standardi zi ng the performance of flight maneuyers--for 
fonpation fliqht for example. However, perusal of some military maintenance 
nanuals or d'iscussions with maintenance personnel, can reveal how arbitrary 
"standard criteria for adequate performance can sometimes be. Without to<ing a 
stand for or against standardization, we simply point out that performers will 
make facilitative trade-offs where possible. The trade-offs often follow from 
idiosyncratic characteristics of performance such as harmonic patterns of 
responses that underlie a given inaividual's skill. Furthermore, the trade- 
offs develop along with skill mastery,. An expert feels less bound to 
externally -imposed standards than does a novice; 

This modification over time of criteria for adequate performance is common 
(Hammerton, 1981). Sometimes it is for the worse. Experts can become sloppy 
performers when there is no need to be otherwise. But thinking of the skill 
"decay" as a problem only of retention can be misl- ading. The '^degradati on of 
. nerfomance in this case would result from conii.rom1 sing standards. In view of 
' the fact that sel f-set standards for performance are more endur;ng than those 
externally imposed, and that perfomance to ^elf-set standards is retained 
longer (Laabs X Simmons, 1981; Locke, Shaw, Saan, X Latham, 1981), it is 
important that military standards be taught in a way that they become incor- 
porated into the value system of the performer at the outset. \t is also 
m ortant that the goals be specific and. to the l^^'""^'-' /^.^JJ^J^ 
Pt al 1981) An obvious implication: a training device that can be, 
"ninhaVled a trainiVig atmosphere that allows pinballing to occur will 

• at besV delay opportunities for many students to set realistic standards tor.. 

• qLlity perfonnance. At worst. Idiosyncratic standards will be adopted that 
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win result in negative transfer in the short term, and in an attitude that 
could have later, enduring effects on performance. \A moment's reflection 
will reveal that what is often called a, "poor attitude" in perfonners amounts 
largely to their inadequate personal standards for -performance. ) . 

A related point concerns training devices that, because of low fidelity or 
incomplete provisions for a task, do not allow for performance to a desirable 
standard. It would be important that, when such devices are used, the tasks 
covered during practice be restricted to those for which desirable standards 
could be communicated verbally, thus maintainiag, at least a cognitive basis 
for later discrimination of standards.' 

Planning Perfonnance . The planning o~ task performance is usually thought of 
Tn terns of deliberate, conscious efforts to bring cognitive processes to oear 
on skills. In basic behavioral terms, the planning is to develop immediate 
and conti ngent sets for cue di scrim i nati ons and i nterpretations and for 
response selection and initiation. Deliberate analyses of the peculiarities 
of given, si tuations are to' guide adaptations of the processing of this infor- 
mation, including expectancies (templates) regarding the nature of feedback 
during perfonnance. These aspects were discussed at length in Section III. 

By design at least, military training and operational procedures provide 
extensively for these deliberative aspects of task preparation. In practice, 
the planning is sometimes slighted, perhaps most often in preparing students 
to derive maximum benefit from training ^evices. Caro et al . (1981) discussed 
this neglect in the use ; of aircrew training devices from several different 
standpoints and explainecj "now careful planning by the instructor, and judi- 
cious use of device traihing features, could enhance device success. Their 
points need not be reviewed here. Suffice it to say that the implications of 
their recommendations extend to training all .ills. 

Of :T>ore immediate concern^ are the nondeliberative aspects of planning. These 
largely unconscious procejsses are, if anything, probably more fundamental to 
motor skill performance than the deliberative aspects. Of special importance 
are the recal ibration of cues, establishment of cue expectancies (recall from 
Section II that cues as defined imply actions), and the establ i shment of. feed- 
back teiT^plates. The ramifications of these factors, a 1 1 ^components or sets 
that govern action, extend beyond task planning into the execution and moni- 
toring of actions. The more general role of recal i bratlon of cues was 
discussed under Intersensqry Transfer. The other two topics ar^ treated later 
under Execution of Actions'. 

Infonnation Processing Strfategies . During the early stages of ^skill acquisi- 
t1on, performers seem to (process information regarding individual skill com- 
ponents independently of jthat relating to other components. ' Depending on 
skill complexity, they may even ignore several components at any given time 
(e.g.,. the focus on glio.,slope versus angle of attack versus line-up by navy 
pilots discussed earlier). With practice, joint .processing develops, appar- 
ently with complex hierarchical relations among cues, response contingencies, 
monitoring sequences, and iother foci of attention. The result is a dependence 
of skin coprdi nation on jthe integrity and adaptability of entire hierarchiaV 
processing schemata. 
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very little is known about schemata as they actua^y function during perfor- 
mance of r.iotor --kills. Reference is often made to "motor programs but little 
i<; <;ai'< about their functional structure beyond analogies to gross charac- 
lerlstios of computers. Research has established, however, that processes 
corresponding heuri^^tically to these hoiions do exist (Summers, 1981). 

There is one area related co '".(rategii^s of information processing that nas 
been investigated to considerable ex :enr., albeit with a restricted forus. 
rertain aspects of these studies were di scupsed earUor ^5 - svgiial deteccion 
theory and statistical decision theory. It was pointed out that with these 
approaches, signal detection could be mathe.n.tical ly J^^^al 
processing. In doing so, signal process;-:i i< often reduced to likelihood 
ratios" (Baird S Nonis:, 1978;, wnich -e bases for computing speed-accuracy 
trade-offs or response; probabilities. 

A related topic, stimulus encoding, has also been the focus of several studies 
of motor skills, but :the concept is not as well integrated ^"to mo, ^^or- 
mancP a^ it is in eoqnitlve skills. It was discussed at length in Section 
nf so for present purposes, "encoding" will refer simply to cue discn.n.na- 
tons It is clear that encoding strategi.s-i .e. , the process of aiscrimi- 
na?inq cues-can change with practice. Rabbitt, Cumm q, and Vyas ( 979) 
Soted that their subjects acquired hierarchical processing patterns for den- 
tifying target letters mixed with distractor letters. From original strat- 
eiv of considering each target letter an independent event, they developed a 
I2i-s^ process in which a letter was first identified according to .ts class 
Uarqet or nontarget), and then as a particular '.atter of ^tne target c.ass. 
T^e greater the comp exity of a skill, the more significant such changes 
should b' Comniex Mills include numerous cues, and on logical grounds it 
an be e'xpected;that hierarchical processing will result in more '"^PJ ^ue 
discriminations than a serial cue-by-cue search of memory wo^^ J; . . R^'^J^JJ 
( 581 especially stressed qualitative changes m encoding strategics that 
occur with practice: "subjects do not simply reta-n a,nj improve the sa,e 
^tr^^Poles of signal recognition, but -ather develop new c-nd mere efficient 
ways o'f d^a^ing wfth particular discriminations" (Rabbitt, 1981. p. 160; see 
also Schmidt, 1968) . 

Of particular present interest are studies of verbal factors in encoding. 1^ 
a certain extent, thes6 factors appear to parallel the hierarchical organiza- 
tion 0- the process, if indeed semantic organization is not on occasion the 
Sa?1s for the hierarchfcal -Wanlzation. Furthennore. semantic organizatior, 
r^n be taught For b-tter retention. 1t sometimes appears that learners 
Should be encouraged to provide ^heir own labels (Laabs & Simmons, 1981 

? r than to ha?e them^ imposed, but this may ^.'^^.l^^t oaTf r 

of X cue systems. At any rate, learners often need help at least for 

sc out the major class_es_of cues. _ ^ 

With aoDropriate verbal gjidanc'e, part- task training devices can aid ip. the 
sorSinq process. Vht p,rt--tas'^ ^riouW-prob^ab^' involve subsets of cue- 
rpsoonsc sy^t^s hot wnuTd eve. tually acquire tr.eir own hierarchical organi- 
zation mor>^^^ 1^ independently of the oroaKlzatlonal relations of the 
^uh.?"s themselves t'. other, subsets not represented in the pert-ta^k dtv^ce. 
l^^^X^^^sLt car. shoulo be.tal^n .o mi. cue- response. .^^^^^^^^ 
indiscriminately during part-task training. It may del.y o, even p.ev.nt 
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their hierarchical organization, or worse, lead to organizations that are 
inappropriate for full task performance. 

One more cl acteristic of efficient information processing strategies should 
be mentioned. The schemata involved should include definite "if-then" expec- 
tancies. Performers should be able to predict the results of their actions, 
or of equipment functioning, in the sense that they can anticipate what will 
follow froiTi Q given control input or state of the equipment. The anticipation 
not only Implies knowing what should be done and how; it also penmits keying 
on selected components of feedback patterns and response initiation processes. 
As pointed out under Temporal Characteristics of Movements, reaction times to 
individual cue:> cannot be rppid enough for some actions. There must be a 
means of using certain cues that appear relatively early In a sequential 
action to initiate movements that are not due until later. (For rdpid move- 
ments, "early" and "later" may be separated by only a fraction of a second,) A 
significant part of any efficient infonnation processing strategy is an habit- 
ual sec to anticipate and respond accordingly; and when motor skills are 
involved 1^ seems to be the anticipation that leads to efficient timing of 
response patterns (Schmidt, 1968, 1971). 

Such sets are necessarily complex. They involve temporal control of sensi- 
tivities to cues, which vary with expectancies, and adjustments of speeds of 
reaction times to anticipated harmonics or other temporally governed occasions 
for responses (Rabbitt, 1981)- Furthej-more, the sets must remain flexible 
throughout response execution. 

As is well known in the training community, understanding one's perfonnance 
requires the ability to predict what will follow from control inputs or the 
status of equipment. Instructors often require students to make such predic- 
tions as a way of teaching understanding, and a variety of training equipment 
includes features to facilitate this instructional practice. Perhaps, 
however, there has not been enough emphasis on the automatic, nonconscious 
expectancies that must develop for many sequential actions that require rapid 
follow-throughs or adjustments. Clearly, these expectancies must be habitual 
to the point motor actions progress automatically (Keele, 1968), so any 
training technique or equipment that fosters such habituation is to be 
desired, 

EXECUTION OF ACTIONS. The execution of skilled actions derives largely from 
cognitive strategies and the motor mechanics of the movements involved. There 
are also continuing monitoring of actions, and adaptations of movements and of 
strategies that are indicated during monitoring or as conditions for perfor- 
Tiance evolve. All of these aspects have been discussed, some more than once. 
However, a few additional comments are In order regarding two topics: (1) 
motor programs and schemata; and (2) monitoring of actions. 

Motor Programs and Schemata . The purpose here Is to provide perspective for 
earHer piecemeal discussions of motor programs. First, motor programs can 
be and often have been, viewed es mechanical systems that incorporate little 
If' any concurrent feedback. Once activated, they progress to completion, 
influenced only by forcible disruptions from external circumstances. There is 
an obvious logical difficulty with such a conception when It is applied to 
skills that can be performed in varying conditions. One must posit a separate 
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program for every condition in which performance does, or could, occur--in 
#short, an unlimited number of programs for each adaptable skill. Where do all 
these variations come from? A less obvious difficulty, but according to the 
evidence just ds real (Adams, 1977; Summers, 1981), i^ the fact that feedback 
does affect the execution of even very brief, very rapid, seemingly fully 
automatic movements such as throwing a ball. 

Schemata have been postulated to take care of both difficulties, and in doing 
so invokes definite cognitive control of motor programs. As with cognitive 
skills, a hierarchical schema for a given action determines a particular 
strategy* establishes standards, adapts encoding of information and feedback 
templates, and adjucts responses to the requirements of .a situation. With 
these preparatory adjustments,, a motor program then takes over. Instead of an 
unlimited number of programs for each skill, there need be only a few at most, 
perhaps only one, to be "edi ted" by higher-order schematic processes. 
Further, the higher-order processes "constitute an executive control system 
that is feedback dependent" (Glencross, 1977, p. 25), thus accounting for the 
effects of feedback even on brief, rapid movements. 

Nevertheless, a qualification is needed if motor programs and schemata are to 
be useful training concepts, A rigid separation of schemata from motor 
programs can have restrictive, probably impl ausible imp! i cations. For 
example, one might conclude that, being dependent on schemata^ transfer of 
motor skills is essentially a cognitive process; or that interference from 
nonexternal sources is purely a cognitive matter. As important as cognitive 
processes are for transfer of motor skills, this seems to go too far, (See 
discussion of difficulties of separate linguistic and experiential LTMs, 
Section III,) 

Similar criticisms could be leveled at training implications of separate sche- 
mata and motor programs. However, the point is that a rigid separation of 
schemata and motor programs should not be attempted in the first place. Of 
more practical concern in training are the functional characteristics of 
behavioral organization. At times, 1t may be desirable to view schemata as 
programs, or vice versa, or to ignore the concepts entirely. The critical 
issue for such decisions is the Importance for given purposes of focusing 
attention on mechanical aspects of skills, the role of feedback, specific 
generalizations that lead to skill robustness and transfer, or mechanisms 
whereby sets or learning sets affect performance. 

Monitoring of Actions, An obvious fact about the execution of an action is 
that sensitivities to and interpretations of cues vary with progressive stages 
of the action. In many Instances, these changes result from a need to fine- 
tune feedback templates to the requirements of particular conditions that were 
not clearly anticipated at the outset. Experts typically make such adjust- 
ments quickly and with a minimum of deliberation. On the other hand, novices 
may need at least brief periods for deliberative analyses of conditions, as 
well as a night to "think it over" following an insightful debriefing by an 
Instructor. Training devices can allow for deliberation as needed; and pro- 
perly designed, they can provide varied enough conditions to force the need 
for, and thus practice of, the process. 
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Of equal concern are t; .anqes in cue sensitivities ' ntr ations that 
should follow the natural evolution of an action. Whc . should attend from 
stage to stage depends on the stage^ The good instruc guides the student 
in this respect: "When beginning, you need to watch for A, B, and C. Then, 
at this poiiit, notice this change in C as well as D and E. Finally, when you 
are about through, check the status of X, Y, and Z." 

Such successive cognitive encoding? can be enhanced with training devices that 
permit cue augmentation and signals to alert the student to feedback con- 
ditions he may not be noticing. In some instances, dependence on memory and 
other cognitive processes can even be increased during early training with 
part-task and low-fidelity^ de^n'ces. Forced mental rehearsal (Wheaton et al . , 
1976; Glencross, 1977) of What should happen, how one should recognize it, and 
what one should do about it is perhaps the most efficient way to crystal ize 
this aspect of perfonnance strategies. 

ORGANIZATION OF MOTOR SKILLS 

Two topics discussed under this head, integration of skills and 
hierarchical organization of skills, address, respectively, the process of 
acquiring skill organization^ and an important characteristic of skills that 
have been organized. Theories of cognition (Section III) inr^'^^ ite these 
topics deliberately; theories of motor behavior have hardly ed them. 

Two other topics, the effects of Interference and the effi fatigue, 
focus on factors that can lead to disruption of skill organizatt u., 

INTEGRATION OF SKILLS. Integration of a complex motor skill involves con- 
joint, precise functioning of numerous motor, perceptual, and cognitive pro- 
cesses. Members of the training community appear to have good, perhaps 
considerable intuitive knowledge of what is involved, at least in a general 
sense. However, there has been no concerted effort to analyze the process of 
complex integrations. Most logical and empirical analyses have focused on 
simple skills as observed in laboratory settings. Even then, with relatively 
few exceptions (e.g.. Pew, 1966), the process of integration has not been the 
object of study except in restricted areas such as signal detection. Models 
derived from most other studies address performance of existing skills, not 
thei r acquisition. In fact, in much modern work on motor skil 1 s, experi- 
menters do not even start collecting data until subjects have practiced enough 
for performance to stabilize. Whatever new Integrations were involved had 
already occurred. 

Earlier analyses in this section identified a number of skill components that 
must become integrated for the performance of complex motor skills. In addi- 
tion, numerous factors, conditions, and basic behavioral processes that deter- 
m1 ne or otherwi se affect the nature and progress of i ntegrations have been 
discussed. Because of the urgency of everyday training problems. It Is 
tempting to. throw caution to the wind and construct a speculative model for 
the acquisition of skill integration, derived from the characteristics of the 
behavioral conr.ponents and processes. 

There are alternatives, however. First, the implications of these analyses 
are of considerable import to training with or without a comparable 
understanding of how students finally "put it all together." A second 
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alternative is the development of a methodology for actually observing the 
status and progress of skill integration. An adequate methodology for this 
Duroose which could ' d to any motor skill would dispen-^ th the need 

for a theory of in i. Although a systematic r -th' y obviously is 

not represented in Uit= , three examples will illustrat- feasibility of 
one. 

Data from Martin and Waag (1978) provide the first exa.nple. Two groups of^ 
subjects flew training sorties, ten by each subject, in the Advanced SimulaTor 
for Pilot Training (ASPT). One group experienced platform motion and the 
other did not. The performance of each group was rated on various tasks by 
instructor pilots (IPs) during five of the trials. The data points in Figure 
1 represent mean ratings for each group on an overhead pattern. The point- 
are connected with straight lines to provide a contrast with Figure 2 where 
solid curves, fit by the least squares method, are shown representing the 
logistic equation, 



1 + ge"^'^ 



Bearing in mind that the IPs used a 12-point rating scale, and that the 
highest mean rating for eith group was 6.56, what do the curves in Figure 2 
suqqest that is not apparent i Figurel? First, it appears that the Putterns 
of data may well say more about the effects of motion than the data points per 
se can reveal. The curve for the motion group is still rising on the fifth 
evaluated trial, while that for the no-motion group is not. The asyniptotic 
level A for the motion group, computed from the above equation, was 8.97, but 
only ^36 for the no-motion group. 1 The indications are that the motion 
group in spite of lower average parfonnance, could have continued to improve 
well beyond the plateau reached by the no-motion group. 

Second it appears that progress for the motion group was delayed because they 
had to integrate the motion cues into the skill pattern. There was probably 
some interference at the outset, but assimilation eventually occurred. This 
inference is supported by examination of the inflection points for tne curves. 
(The inflection points are the X [trial] and Y [rating] values. Px_ and Py, 
respectively, at which positive'acceleration oT either curve ceases and TTie 
cu-ve becomes negatively accelerated; see Section V.) While basic information 
is first being integrated, a learning curve typically has positive 
acceleration, with negative acceleration thereafter. For the no-motion group. 



Ho illustrate how As do not depend unduly on the nature of the equation 
used, the data were also~fit using the radically different Gompertz function, 

Y hg^^ . 

Essentially identical" curves were obtained, and the As were 9.08 and 6.38 for 
motion and no-motion groups, respectively. 



96 



erIc 



-X MOTION GROUP 



O— 0 MO-MOTION GROUP 



T I r— T 

2 3 4 5 



EVALUATION TRIAL 



PERFORMANCE ON THE OVERHEAD PAHERN 
IN THE ASPT (DATA FROM MARTIN & HAAG, 
1978}. 



101 




FIGURE 2. SAME AS FIGURE 1 EXCEPT Ml 
REPRESENT FITS TO LOGISTIC E^^ 



NAVTRAEQUIPCEN 78-C-0113-4 



Px = 0.90, while Px = 2.78 for the motion group. These are equivalent, respec- 
TTvely, to Pys of^ 3.18 and 4.48, The inference is that (1) the motion group 
used motion cues; (2) it took them more trials to^ integrate the additional 
Information; (3) once assimilated, the motion group was at a higher level of 
performance than the no-motion group at the time of their assimilation of cues 
available to them; and (4) the additional motion cues may have resulted in a 
higher level of performance had practice continued, (Data not discussed here 
indicate that A can be highly predictive of continued performance; see Section 
V.) 

A second example, taken from Smith, Waters, and Edwards (1975), illustrates a 
quite different process of assimilation of information, one i nvolving^ the 
' direct effects of cognitive processes. They gave one group of student pilots 
i ntensive cognitive pretraini ng to aid in recognizi ng fl ight segments and 
landmarks, while a control group had only "normal" instruction. Figure 3 
shows logistic curves fit by least squares to the mean number of flight 
segments recognized on each of the first fourteen aircraft rides. Both groups 
eventually recognized all segments, so _As are of no concern. However, the 
pretrained group started at a higher level, 1 and had an earlier inflection 
point (Px = 1.88 versus 3.73). The levels of performance at inflection were 
comparaBTe (Pvs = 2.09 and 2.04, respectively, for pretrained and normal 
groups). The cognitive pretrai ning • thus appears to have resulted in earlier 
assimilation of information that both groups eventually completed. 

The third example involves data from an exploratory study mentioned earlier 
(Isley & Spears, 1982; Isley et al , , 1981), Navy pilots practiced simulated 
carrier landings. During early trials, percents cf time in tolerance on 
approaches generally correlated negatively for glideslope, ann1^- " -^t' k 
(AOA), and line-up, both during the. entire approach icrt . , . .le 
approach. Th" correlations became generally pO: ive later in practice, 
.umior., tridis 32-48, average performance for all three components 

no I Iter than for trials 1-16. (This statement needs some qualification; 
for exploratory purposes, some simulated conditions were so inadequate that 
pilots exposed to them could not perform at all at the outset, and one pilot 
made no progress at all under his conditions,) However, examination of per- 
formance curves revealed an interesting fact. A subject may begin with a high 
percent in tolerance for one component, say AOA, and low percents for glide- 
slope and Une-up, With practice, AOA percent ^woul d drop and the others rise 
until they were essentially the same. Then curves for all three percents 
would begin to rise together. The early negative correlations were due . to 
performance on one component deteriorating while that on one or both of the 
other components Improved, Later positive correlations resulted from parallel 
improvements on all components. 

Even though performa^nce aiveraged across components was no better ^or trials 
32-48 than for trials 1-16, it was evident that considerable learning had 
occurred. From extremely varlabl early performance, midway through a common 
level was achieved across components which was generally lower on the average 
than originally. Then, performance on all three components Improved together, 



By setting X = zero in the logistic equation, estimates of performance 
levels prior to the first trial were obtained, 1,49 segments for the pre- 
trai ned"group~arrd 0.88 for the normally trained group. Again, see Section V, 
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and with relatively llj^tle variation among components. The pilots apparently 
started put by concentrating on one component at a time, then two, and then 
all. three. Thus, it was easy to track the^ integration of all three components 
i n the data. 

Although the analyses discussed have not been employed earlier in afiy syste- 
matic sense, these three examples illustrate the feasibility of a syst^atlc 
methodology for observing (^and quantifying) skill integration, 

HIERARCHICAL CHARACTERISTICS ' OF MOTOR SKILLS* Psychological theorists have 
used the conceptual- tooV of hierarchical organization for some time in 
expTalnl ng . behavior. This has been especial ly ' true of theories of choice 
behavior- as involved in schemata, Beginoing with Thurstone (1927) in 
psychophys1.es and Hull (1943) in general S-R_hearning, hierarchical theories 
of .choi'ce behavior became axiomatic and maThematical • Building especially on 
Thurstonian fo.undat-^ons, other theorists (e.g.. Luce, 1959, 1963) have 
expanded choice theory and related mathematical techniques to embrace almost 
any hierarchical syr>tem in'^^which *'dom1 nance" is the essential characteristic 
(see Baird fr Noma, 1978, for a general review). Today, theories of cognition 
often posit hierarchical relations ^qfr almost all aspects of infonmatlon 
processing (see Section III). /V 

As pointed out on several occasions in fQr,egoi ng di scussions, a variety of 
aspects of motor skills have hierarctiical characteristics, ' These aspects 
.range from single component clusters such, as cue discriminations to 
situational adaptations of performance that can be ascribed. ^6 analogical 
hierarchical schemata. As emphasized fn"^ct1on U, however, to make maximum, 
use of hierarchical conceptions. It Is* necessary to focus on functional rela- 
tions as the organizational factors. Jhey can Include "levels" and 
"dominance" v<1thout being restricted to these relations. Thus, for example, 
cuel ng sequences as wel 1 as, say , level s of cue di scrimi nations, can be 
brought under the concept of hierarchy"! TFfe shifts that occur wttK practice, 
from waiting for a "new" (i.e., next) cue before responding to lettinn 'ie 
last response cue the next one, can thereby be analyzed within many of ihe 
mathematical frameworks devised for dominance relations. 

Versatility of this nature is required if the complexity 'of hierarchical 
organi;:ation .is to be brought to taw analytically. Control loops and their 
governing schemata, for example, require not only feedback but fee dforward 
(Summers, 1981). Which component 1s dominant over another may change almost 
conti nuously . ^ . . „ 

information now available In training 11terature--t^sk analyses and emfj^irical 
""studies of task perforniance--shoul d prove very helpful in identifying a1[ least 
tentative hierarchical .organizations for many skills. Wheni4:he organizations 
are vfewed in terms of the analyses of cognitive and motoc skills as dis- 
cussed, it should be possible to address training considerations involving 
them. For part- task graining, for example, which tasks. are the best candi- 
dates? How should they be grouped? In what order shoufd they be- practiced 
and how far should mastery progress on each part separately? What are -the 
requirements for whole-task Integration an^l how should they be met? The anal- 
yses of functional relations that determine answers to these questions 'must 
consider all components of skill performance, from hierarchical structures of 
encoding to those of the complete skill. . . 
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EFFECTS OF INTERFERENCE. Interference effects have been mentioned in connec- 
tion with a number of topics. It should be apparent that an advantage of tho 
analysis of skills as presented here and in Section III is that the complexity 
of interfering processes can be appreciated. In understanding the complexity, 
' one can address issues of training and of negative versus positive transfer 
specifi-cally. It is not sufficient to know» for example, that training with a 
particular devisee resul ts in negative or 1 ittle. positive transfer. In 
designing a training device and selecting tasks to T)e taught with it, one 
needs to know the sources of likely interference and negative* transfer. Is 
the nature of movements the trouble? Direction of movements? .Loss of initial 
positiQ/i? Are conflicting harmonic patterns established? Do students adopt 
inappropriate speed-accuracy or facilitation trade-offs? Are performance 
standards compromised? 

There is another .aspect of interference which has not been mentioned thus far. 
In verbal learning, this aspect is subsumed under proactive and retroactive 
"inhibition." The significance for present purposes of these sources of 
Interference is in the selection of tasks to be trained and patterns for prai- 
tice^ For example, a number of studies of motor performance have shown thart 

rconstant (mean algebraic) errors in one simple movement shifts in the direcA 
tion of--is assimilated into--characterist1cs of prior (proactive inter-' 
ference) and .interpolated (retroactive interference) movements. (See Laabs & 
Simmons, ,1981, for a review of these studies.) In some cases, proactive 
inf4uenc.es. are effective only for very brief periods that can be measured in 

.secat)ds {G^ft & Hinrichs, 1971). Furthenmcre, interference effects, can be- 
highly specific. Distances of Interpolated movements affect distances of cri- 
tetj^ion^fTjove^ents; end locations affect end locations (Laabs\5 Simmons, 1981), 

The(j:€fvTew by Laabs and Simmons left out a significant point. Whi.le they 
noted that the entire cue context is operative in interference, that inter- 
polated mental^ act ivi ty is not particularly interfering in movements, and that 
the use or verbally encpded cues reduces cue conflicts, they failed to draw 
the inference of most va"(ue in training. Interference is inversely related to 
the degree of discrimination of cue-response systems. Verbal processes, 
including "mental activity," are not ihtei;fer1ng to motor re'^ponses because 
they^.are supreme examples of f^eneral ized discrimination systems. ' 

..Learning of complex skills requires practice of a number of ^components that 
are mutually interfering to a novice. What the training developer needs to 
know is how overall detrimental effects of the interference can be reduced, 
and the interference itself eventually accommodated or removed. 

Discriminations facilitated by deliberate verbal encoding by the learner can 
neduce detrimental effects (Diewart & Roy, 1978), as can' achieving a reason- 
able level of masteQi on one skill component at a time. Mastery implies 
discrimination of cue-^response .systems, :*:d the greater the mastery of .one 
motor skill compon:r.t relative to another , the less the mutual interference 
(Osgood, 1953). !?ut note the reference to, "reasonable level of mastery J'* 
Oddly enough, in the learning of multiple motor skill compojients', the 
"vertical" transfer among components typically reaches a maximum prior to a 
high degree of mastery (Gagne 4 Foster, 1949). Therefore, a trade-off between 
PQSitive and .Negative effects is in order, the precise nature of which should 
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vary according to interactions of components characteristic of particular 
skills. 

EFFECTS OF FATIGUE. As with interference, the analysis of cognitive and motor 
skills, of their components and organization, makes possible specific state- 
ments regarding the effects of fatigue on performance. Although not espe- 
cially pertinent to present purposes, a brief review of these effects will 
round out these analyses. More important^ the effects themselves can serve as 
indicators of inefficient training regimens. If a training session or prac- 
tice on a particul ar task is too long or intense, resul ting fatigue can be 
detrimental to learning. As explained below, unwanted alterations occur in 
p^formance. If these alterations are practiced, they are likely to be 
learned. At best, th*? undesirable aspects would interfere kith the learning 
desired, and at worst replace it. A good rule to follow is to let training 
progress to the point of noticeable fatigue only when the specific purpose for 
the training is to accommodate the fatigue. ^ 

Holding (1981) gave a succinct summary of fatigue effects on skills. First, 
there is a deterioration in personal standards for performance. The deterio- 
ration may resul t in lax monitoring (e.g. , greater tolerance of deviant 
readings on instruments) or in acceptance of less than adequate perfonnance 
outcomes. Second, there are lapses in attention, if not overall, at least for 
cues and actions related to peripheral aspects of the task. In other words, 
what are perceived as essential aspects may be attended, but not those pri- 
vately considered non-essential. Thifd, performers become more easily 
distracted, with consequent loss of acuity needed for monitoring performance. 
Fourth, there Is a tendency to "cut corners" during performance. 
Shingledecker and Holding (1974) reported that subjects who had first become 
fatigued on a complex monitoring task tested fewer components on a following 
fault isolation task. They were willing to accept the risk of not identifying 
the faulty component (facilitation trade-off with a new perspective). A simi- 
lar reduction in effort was found by Barth, Holding, and Stamford (1976) in 
subjects cranking an ergometer after running on a treadmill until tired. 

These last three effects oT fatigue can all be considered variations of the 
first one, deterioration of standards for performance. (They can involve 
different mechani sms and indicators, however. ) Other effects relate to the 
breakdown of overall skill organization. During fatigue there is greater 
variability in responses, especially in timing. In some cases responses that 
would be correct at some points are simply made at the wrong time. In others, 
response integration deteriorates. We might hypothesize that movement ht r- 
morilcs aro disrupted, probably due either to inconsistent or delayed reaction 
tii'ies. Ihls seems to have been the case with the fatigued runners studied by 
Bat':.>,. Osternig, and James ( 1977). Fo6t descent became slower, forward swing 
of the legs more rapid, while other components did not change in duration. 
Holding (1981) also noted that integrated skills tend to "separate" into 
individudl components during fatigue. 

f inally, there can be a deterioration In judgment. Fo^^ example, Brown, 
Tickner, and Simmonds (1970) found that during the last three hours of a 
twelve-hour driving stint, drivers attempted 50 percent more "risky" over- 
taking n^aneuvers than during the first three hours. Brown et al . ' s data are 
at odds with those of Potts (cited by Brown et al . ) who found that "near 
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accidents" decreased with time on task. However, Ignoring the difference In 
criteria, there can be significance In the apparent contradiction. Potts* 
subjects were long-distance truck drivers and apparently Brown et al.*s were 
not. (The latter subjects were Identified only by ranges of age and driving 
experience.) Either through safety training programs or experience, truck 
drivers would be more likely to learn to accommodate fatigue, to anticipate 
its effects and correct for them. If this Is the explanation, perhaps it can 
suggest ways to trai n for f ati gue accommodati on for 1 ong or tedl ous ( or 
boring) tasks. 
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SECTION V 

MANIFESTATIONS OF TRANSFER IN TRAINING 



The concept and mechanisms of transfer (and interference) have been 
treated at length in earlier discussions. Section II attempted to set the 
stage for later discussions by establishing (1) that transfer is a process of 
learning as well as a product; (2) that "common element" conceptions of 
transfer are truly as inapplicable to training as critics of this approach-- 
including some who adopt it in practice — would have us believe; and (3) that 
transfer can be reasonably understood only if its locus is seen as mediational 
processes. 

Section III expanded all three points at length. In fact, there is 
nothing discussed in Section III that does not involve transfer. All short- 
tenm processes draw on long-term memory (LTM)--past experience--for atten- 
tional processes involved in signal detection^ for encoding of inputs and 
their elaboration, and for retrieval of information. Jhe executive processes 
are ipso facto discriminative^ generalizing transfer systems. As analogical 
schemata, they determine how a task is "recognized" (defined) in terms of 
situations, how task performance is comprehended and planned, and how ensuing 
actions are monitored, regulated^ and evaluated. 

Section IV extended the discussion to cover motor skills. As in Section 
III, the roles of transfer (and interference) are seen to be complex. Facili- 
tation or disruption can occur at numerous points during processing; one com- 
ponent of a skill may show effects of training the opposite of that for 
another component. 

But training devices^ especially part-task and low-fidelity devices, 
raise a further transfer issue. Trainees who learn skills using them must be 
able to practice the skills with equipment, and in situations, that differ 
qualitatively from those for training. It is not practical for training 
developers or the designers of training equipment to anticipate the myriad 
possible transfer effects that can occur during,. and as a result of, device 
training. It is enough to recognize generally what might happen, at what 
stage in processing, and why , and to provide for contingencies as best they 
can. A later extersion of the present effort is to develop definite guides 
for these purposes. Nevertheless, there will usually be enough uncertainty to 
call for empirical indicators of the nature of t-^ansfer of device training to 
operational equipment and situations. 

The purpose of this section is to present four such empirical indicators. 
All are parameters of performance curves that can be readily quantified. 
Three of the performance parameters, beginning level, asymptotic level, and 
rate of learning, have been used 1n the experimental psychology of learning 
for some time. Also, their value for measuring transfer has been recognized 
(cf. Deese, 1950, p. 216; Woodworth A Schlosberg, 1954, p. 736-738). The 
fSurth parameter, an inflection point. Is a derivative of rate. To the 
writer's knowledge. It has not been used previously to measure either learning 
or transfer. 
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Each of these parameters 1s described in the discussions that follow, 
along with training factors that can affect them. Their measurement is 
illustrated using data from studies of training. The examples are drawn from 
pilot training because these data were readily available. The points made 
apply to al 1 traini ng, however, for the conceptual Izatlons and quantitative 
fonnul atlons origi nated in hundreds of empi rical studies of 1 earning of all 
kinds. While the focus Is on transfer, the use of control groups shows that 
the measures are generally applicable to both original learning and 
transferred learning. 

There is also a brief discussion of the significance of each parameter 
for studies of transfer In applied settings. To simplify discussions, a con- 
vention is adopted to distinguirh between the learning that is to be trans- 
i-err^d-^nd-the learning or performance that is presumed to be affected by the 
transfer. Following the usual paradigm for studies of transfer, "Task 1" will 
designate the skil Is practiced by a learner, the effects of which on later 
perfomiance or learning are at issue. "Task 2" will denote the skills whose 
later perfomiance or learning is the basis for inferring Task 1 transfer 
effects. Task 2 would be the first task, of course, for a control group whose 
skill acquisition is to be used as a basis for assessing Task 1 transfer. 

For example, an experimental (transfer) group could pfactice instrument 
flight skills in a simulator (Task 1), and later be tested for proficiency in 
these skills in an aircraft (T, k 2). A control group might practice only In 
the aircraft (Task 2). Transfer of simulator learning to aircraft perfomiance 
could then be assessed by comparing Task 2 perfomiance by the two groups. To 
the extent that the experimental group was superior to the control group on 
various aspects of, or at particular points during. Task 2 practice, positive 
Task 1 transfer will be said to have occurred. Conversely, to the extent the 
opposite is true, the inferior aspects of perfomiance of the experimental 
group will be tenned negative transfer. Zero transfer will mean that Task 1 
pragtice had no effect either way on Task 

GENERAL COMMENTS REGARDING CURVE FITTING 

Measures of tho four parameters require the fitting of curves to learning 
and transfer data, and discussions of the parameters will require fewer 
digressions if seven points regarding curve fitting, equations used, and 
interpretation of results are clarified. First, curve fitting assumes that 
learning and transfer are lawvul processes. If this assumption cannot be 
justified, all efforts to stud> variables affecting these processes are in 
vain. A hundred years of research have shown unequivocally that learning and 
transfer are highly lawful, and highly predictable when extraneous influences 
on the data are controlled. It Is also well known that a number of equations 
can describe the observed regularities. That is, they can relate observed 
dependent (Y_) values to functions of Independent (X_) variables within the 
limits of experimental control. Furthermore, the choice of equations can be 
based completely on eripirlcal considerations. No assumptions need be made 
regarding the nature of learning and transfer, and no theory Is involved 
unless the researcher chooses to ise theory. 

Second, curve fitting permits the use of all data to derive measures for 
each of the four parameters. In contrast, consider customary methods of 
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measuring rate of learning and Task 2 beginning level. Rate may be estimated, 
for example, by comparing achievement on first and last trials, and beginning 
level by measuring achievement on the first one or two trials. However, 
results for individual trials are quite unrel iable--notoriously so for first 
trials--so a^valid method that uses all data for each measure is necessarily 
superior. 

The third point follows directly from the second. Individual trials in 
applied training research are often subject to a variety of uncontrollable 
extraneous influences such as weather variations during' aircraft practice, 
irregular spacing of trials; use of substitute instructors, etc. Curve 
fitting cannot remove the need for experimental control, but by deriving 
measures from the data as a whole, fluctuations due to uncontrollable Influ- 
ences on individual trials are cancelled out for each parameter to the extent 
they are random across groups. Curve fitting also permits reasonable esti- 
mates of what would have occurred on a given trial if the uncontrollable 
influences had not been present. In other words, if curve fitting had no 
other advaintages, it would still be desirable for research in applied settings 
where rigorous experimental control is not possible. 

Fourth, all curves discussed in the following sections were fit using the 
least squares method. That is, constants for the equations represented by the 
various curves were derived so as to minimize the overall squared errors in 
predicting observed measures of learning or perfonnance from the independent 
variables. 

Fifth, to avoid having to interpret "goodness of fit" of the curves to 
data by relating mean squared errors to variances of the dependent (Y) 
measures, the closeness with which each empirical curve fits its data Ts 
reported as the product moment correlation between actual _Y values and those 
predicted by the curve. The rs tend to be very high, as they should be if the 
data are not too irregular an^J the equations to fit them are properly chosen. 

The sixth point concerns the possible statistical significance of dif- 
ferences that occur in the examples. Data were not available in sufficient 
detail to test for significance, but this is no problem for present purposes. 
The Intent is to illustrate how parameters can be measured and their value for 
interpreting learning and transfer data. Therefore, Illustrative interpreta- 
tions do not necessarily apply to the individual studies discussed. Rather, 
true effects of the sorts discussed are common in learning research, and it is 
the illustration of effects that is of concern, not the particular research 
f indi ngs. 

The seventh point concerns the designation of variables and constants in 
equations. The only experimental variables of concern are the measures of 
learning or performance, represented by Y^, and the Independent variable, 
which can represent measures such as number of trials, hours of practice, 
number of reinforcements, time since practice (for studies of retention), etc. 
Measures of parameters of Interest such as B (beginning level), A^ (asymptotic 
level), R (rate of learning), and ?^ (InfTection point) are represented in 
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BEGINNING LEVEL 

Beginning level B is defined as the level of perfonnance before any prac- 
tice on the task to Fe learned. This definition holds for either Task 1 or 
Task 2 learning. B may well be zero, but such an assumption should not be 
made without ample Trustification. As has be?n stressed, even novices enter a 
training situation with a background of experience that can help learning the 
task at hand. In some cases, of course, prior experience can Interfere wjth 
new learning. Such interference can result in a low or even negative B^. 

B cannot generally be measured wi thout fi tti ng curves to data. An 
exampTe will illustrate why. The data represented inTigure 4 are from a 
report by Prophet and Boyd (1962). An aircraft group practiced a set of cock- 
pit procedural tasks in an AO-1 aircraft. The 2-C-9 and mock-up groups prac- 
ticed the same procedures in a 2-C-9 procedures trainer and a photographic 
mock-up trainer, respectively. - The latter groups then continued practice on 
the same procedures in the aircraft. The data points 1n the figure represent 
mean percent errors on aircraft transfer trials 1-5 for the 2-C-9 and mock-up 
groups, and on original learning trials 1-6 for the aircraft group. There 
were 10 subjects in each group. 

The earliest data available for the complete trial 1 in the aircraft can- 
not be assumed to represent B^. Each trial required from 15 to 30 minutes per 
subject. Unless the procedures involved were completely independent of each 
other--a most unlikely possibili ty--the cumulative experience during trial 1 
will result in the acquisition of new skill components, or the sharpening of 
previously learned ones, that will affect perfonnance later in the same trial. 
It follows that errors in perfonnance observed for trial 1 as a whole are 
determined jointly by a beginning level B^ and rate of learning during trial 1. 

The curves in Figure 4 project each set of data back to the _Y axis. Bs 
are the points at which the curves intercept the Y_ axis, i.e., "achievemenT' 
on the zeroth trial X^^ g^^h curve represents the equation 

Y - h + ge-I^X 

where Y_ is a measure of percent errors, is the aircraft trial, h,f Qt and k^ 
are constants to be determined by fitting the general equation to tne data, 
andjB is the well known mathematical constant. 

Table 1 shows these constants together with percent errors on the first 
trial in the aircraft, derived Bs, and rs between actual and predicted Y_s. ^s 
were derived by letting = 0,1n whicF case e;^X = ^o = yielding B^ = = 

h^ + Comparisons of first- trial errors and show how greatly first-trTal 
measures may be contaminated by rate of learning. The 2-C-9 and mock-up 
groups are not as similar at the outset as they appear at the end of the first 
trial (10.3 percent errors versus 10.4 percent, respectively, as opposed to 
14.9 percent and 19.2 percent for£= 0). Furthermore by comparing ^s for the 
aircraft and two transfer groups, the transfer from preaircraft (Task 1) 
training is seen to be greater than comparisons of first trial perfonnance of 
aircraft and transfer groups indicate. 
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TABLE 1. AIRCRAFT FIRST-TRIAL ERRORS lAtJD VALUES 
DERIVED THROUGH CURVE FITTING V 



Percent 
errors 



Group 


on first 
trial , 




r 




Constants 

1 

■> 


k^ 


Ai rcraf t 


29.5 


50.3 


.994 


4.2 


46.1 


.147 


2-C-9 


10.3 


14.9 


.997 


1.0 


13.9 


.359 


Mock-up 


10.4 


19.2 


.971 


2.8 


16.4 


.273 



Note: Original data from Prophet and Boyd (1962). Constants shown have 
been rounded to too few digits to compute the tabled r exactly. 



Much more could be said about these data if the implications of constants 
_h and k were explored. However, the purpose here is to illustrate a measure 
of _B fBat is independent of rate of learning, and to lay a foundation for 
discussing it later in relation to the other parameters of learning and 
transfer. 

UNITS FOR B. B^ can be stated either in units of Y or of X. In the fonmer 
case, B represents performance level prior to pracTice, as lias been stressed 
thus far. It is just as easy, however, and for some purposes more appro- 
priate, to express B in X units, i.e., the number of practice trials, amount 
of training time, etc., €Fiat, because of experience, subjects had "completed*' 
on an equivalent basis prior to Task 2 practice. In the Prophet and Boyd data 
the beginning performance level of the 2-C-9 group of 14.9 percent errors was 
equivalent to 2.4 aircraft trials, while the mock-up group's B of 19.2 percent ' 
was equivalent to 1 .8 aircraft trial s. In either case f^ere could be a 
substantial savings in aircraft costs for a sizeable group of trainees. 

These trial equivalents were determined by setting the equation for the 
control group equivalent to _B for each of the other two groups and solving for 
X. Another technique is to represent each X in the equation as (X^ + Xp) 
where X^- is the trial number and >lp the _B Tevel in X units which "i:: to be 
determFned (during the fitting of "tne curve. Estimating X^ by the Idtt^r 
method does not require a control group, and the 2^ obtaine3is not dependent 
on the performance of a control group. 

These alternative units for B can be valuable for studies of transfer in which 
comparisons are to be made oT costs of alternative Task 1 training procedures 
or conditions. For example, the amount of Task 2 training effort saved can be 
measured directly in terms of Task 2 dependent variables (level of beginning 
performance) or independent variables (equivalent aircraft trials), whichever 
Is preferred. 
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TASK 2 BEGINNING LEVEL AND TRANSFER OF TRAINING. As explained earlier, ^ is 
an estimate of what learners can do on Task 2 before they even try. It is not 
what they might understand, for example, that will help them adapt quickly to 
Task 2 requirements after they begin practice. This careful specification of 
the nature of IB is important, for as will soon become apparent, how one eval- 
uates facets of a training program, and decides what changes to make to 
improve it, will usually require distinguishing between B^ and other parameters 
of transfer, especially rate of learning. 

Persons who insist that simulator fidelity is required for transferable 
learning apparently have B in mind as the primary measure of transfer. If a 
leaner can do the same things, in the same way, experiencing the same cues 
and feedback, in a training device thst he can using operational equipment, 
then what he learns in the device is ipso facto measured by B. Grant for the 
present that stimulus and response fidelity is one basis for transfer, and 
that it affects Task 2 B^ level. It remains to broaden this conception so that 
B can be seen as a more Inclusive measure. 

Specifically, to the extent that a learner can, through mediational processes 
and especially imagery, construct a psychological realism that equates subjec- 
tive Task 1 experience to actual Task 2 conditions and actions. Task 2 B level 
will be affected regardless of objective stimulus and response similarity of 
the two tasks. The study by Prophet and Boyd (1962) just discussed showed 
this clearly. In a more general vein, Wheaton, Rose, Fingerman, Korotkin, and 
Holding (1976) concluded after an extensive review of research literature on 
learning and transfer that *Mmagi native," i.e., completely cognitive, practice 
could be substitute*] on a one-to-one basis for some practice trials even in 
motor skill learning. The only requirements are that the learner be able 
already to perform the motor acts involved in Task 2 but that cannot actually 
be done during Task 1 (e.g., positioning switches In a photographic mock-up), 
and that the learner's past experience be sufficient for symbolic cues and 
actions to have precise meaning. Under these conditions, B^ measures can 
reflect transferable Task 1 learning of any sort, including some aspects of 
purely cognitive learning acquired during academic instruction. Note, 
however, that some aspects of fruitful cognitive learning during Task 1 cannot 
improve B, and may even depress it. The positive effects become manifest 
later in"lraining. This will soon be apparent. 

B can also be affected in a negative manner, especially when <;ets established 
during Task 1 training restrict adaptability to performance . ^-quirements, or 
when motor coordinations are learned in a device whose dynamics are different 
from, those of the equipment that is to be used operationally. In such cases. 
Task 1 interference (proactive inhibition) can occur. As illustrated in a 
later section. Task 2 rate of learning may well render such negative B 
transfer inconsequential. Nevertheless, for diagnostic efforts directed at 
training program improvements, it would be well to know whether B^ does in fact 
reveal a negative Task 1 effect. Typical measures such as percent transfer 
may show that transfer is substantial overall, but isolating a negative aspect 
makes possible specific instructional or equipment changes that can result in 
even better overall transfer. 
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ASYMPTOTIC LEVEL 

The asymptotic level of performance A^ is a mathematical conception that 
one may have qualms about at first glance. As will be demonstrated, however, 
A can be a very revealing measure of learn-^ng and transfer. The reason for 
"possible qualms will be discussed first, a^.d then valuable uses of A^ which 
such reservations do not affect win be explained. 

A is defined as the limit for Y_ (achievement) as X. (the independent 
variable) increases indefinitely. In the equation used earlier to fit the 
Prophet and Boyd data, 

Y = h + ge"*^^ , / 

one conceives of approaching infinity. As it does so, £-k>L — > 0 for a 
positive Jc^, so — > h, the asymptote for this equation. 

In practice, X rarel> becomes even sizable, much less infinite. Further- 
more, A^'can be a Tlmit of performance only for conditions as they exist. Not 
only v?7ll conditions for skill performance change with time, but changes 
within the learner whil& undergoing training can affect ultimate possible 
achievement levels. The well known "plateaus" in learning curves illustrate 
this phenomenon. A subject may improve during practice up to a point at which 
progress appears to stop, only to accelerate again as the learner makes new 
adaptations to the conditions for performance or new integrations of the 
skills involved. Each plateau represents a temporary A^. Bryan and Harter 
(cited in Woodworth & Schlosberg, 1954) found this to be true in one of the 
earliest experimental studies of skill learning, and it is Illustrated in data 
from Smith, Waters, and Edwards (1975) shown In Figure 5. In the latter 
study, an experimental group received intensive cognitive pretraining for a 
T-37 overhead traffic pattern, while a control group received on^y^ the 
training "normal ly" given undergraduate pilot trainees. Both groups were 
tested during 14 subsequent aircraft rides to determine the number of flight 
segments and landmarks they could recognize. Figure 5 shows the mean number 
of landmarks recognized by each group on each of the 14 rides. The plateaus 
are too regular to ignore. Indeed, to sort out all the effects of the cogni- 
tive pretraining. we need measures of all four parameters--B^, A, rate of 
learning R, and inflection point P. A^ is the present concern, and "the purpose 
of introducing the Smith et al . Sfata at this point is to Illustrate that pla- 
teaus do occur in research on training, to point to their significance, and to 
emphasize that A^ relates to them. 

Their significance was summarized succinctly in McGeoch and Irion's 
(1952) influential text on human learning: "The conditions under which such 
variations as these [plateaus] take place, as well as the conditions which 
determine the rate and limits of Improvement, form the proper subject matter 
for a large portion of this book" (p. 29). In passing, it is pointed out that 
patterns of plateaus such as these are typical when (1) successive integra- 
tions of elements are necessary to progress In a skill, and/or (2) cognitive 
processes must be interfaced with the perceptual and motor realities of skill 
requirements. Thus, the points at which plateaus occur, and the levels of 
achievefnent they represent, can be indicative of importr^nt processes and 
stages of training in ways that reflect training effectiveness and efliciency. 
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FIGURE 5. MEAN NIWBER OF LAHOHARKS REfOGNlIED ON 
EACH OF 14 AIRCRAFT RIDES (DATA FROM 
SMITH ET AL.., 1975). 
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Computed/for each 3»egnient, A can yield a stable estimate of the perfonnance 
level at which a plateau occors. 

To lay a foundation for a discussion of as an Indicator of transfer, 
two other uses of ^ In training research will be Illustrated. One concerns 
Its predictive value In training, and the other Its potential for deriving 
Implications of data that usually are not apparent. 

The data In Table 2, taken from Prophet (1972), represent percent errors 
In p^fonmance during each of the first five days of aircraft practice 
following simulator training. Groups are identified by checkride grades, 
assigned on approximately the 28th day of helicopter trials, except for 16 
subjects who washed out either before the checkride or on the checkride. Each 
group of data was fit using the equation 

Y = AX 
X + k 

where Y is the cumulative percent error, \^ the day number, ^ the asymptote, 
and k a constant related to the rate of learning (see below). B = 0 for all 
groups. 1 Table 3 shows A^s, rank order^of As, and £S between acTual and pre- 
dicted Ys for the various groups. Note tfiat three curves were fit for each 
group, "one usfng only days 1-3, one using days 1-4, and one using all five 
days. For the. four groups at the bottom of Table 3, the ranks of As correlate 
perfectly with ranks of checkride grades assigned some time la€?r after an 
additional 20 or more aircraft trials . The rank correlations are less than 
■perfect when the groups are broken down into smaller grade ranges, but they 
are still high: .93 when all five or four days are used, and .86 for three 
days. 

Of course, in t\]^ example (but not generally) the correlations are just 
as high if cumulative errors are used rather than As. However, as will be 
apparerrt wh^n these data are considered further un'^er rate of learning, ^s 
provide potentially valuable predictive measures in combinations that are 
impossible to obtain without them. 



^When cumulative data represent Y_ values, it is customary to assume 
B = 0 because, to use the present example, no aircraft errors could cumulate 
pTrior to aircraft trials. This argument is arbitrary in that a decision could 
have been made to project errors back in time to preaircraft performance. 
.However, either of two conditions, both of which are satisfied here, justify 
ignoring B so long as It is not of Interest. First, can the data be fit 
"closely ITb is assumed to be iiero? The rs in Table 3 show that the answer to 
this questfon is yes. Second, \f Qs hadTbeen estimated for the groups, would 
the Bs differ? ^he data in descending form (i.e., not cumulative) shown in 
Tabir 2 were fit co ah appropriate function, and Bs were found to be essen- 
tially the same across groups. Therefore, the cumuTative values may be viewed 
as having a constant IB Subtracted from each 2, which would not affect the form 
of the equation or the goodness of fit. 
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TABLE 2. PERCENT ERROR FOR SEVEN MANEUVERS 
BY DAY OF TRAINING AND CHECKRIDE GRADE 



Training Day 



Group 


n 


1 


0 
C. 


J 


A 
H 


c 

D 


Precheckride W/0^ 


13 


63 


62 


60 


57 


57 


Checkride W/0 


3 


60 


51 


58 


45 


55 


70-74 


6 


66 


54 


48 


34 


35 


75-79 


10 


4;? 


40 


36 


30 


40 


80-84 


8 


50 


35 


34 


32 


23 


85-89 


7 


49 


40 


29 


28 


22 


90-94 


9 


45 


35 


29 


22 


24 


All W/0 


16 


62.4 


59.9 


59.6 


54.8 


56.6 


70-79 


16 


51.0 


45.2 


40.5 


31.5 


38.1 


80-89 


15 


49.5 


37.3 


31.7 


30.1 


22.5 


90-94 


9 


45 


35 


29 


?2 


24 


Note: From Prophet (1972) . 

'w/0 Identifies groups 


that washed out. 











TABLE 3. ASYMPTOTIC LEVEL A FOR CUMULATIVE ERRORS BY CHECKRIDE GRADE 
•AND NUMBER OF DAYS USED TO FIT EQUATION 



■ Days used to fit equation 
1-3 1-4 1-6 



Group 




A 


Rank 


r 


A 


Rank 




A 


Rank 


Precheckride W/0 


1.000 


6334 


7 


1.000 


5296 


7 


< 

1.000 


5031 


7 


Checkride W/0 


* .999 


1264 


5 


.999 


1384 


6 


.999 


1606 


6 


•70-74 


1.000 


713 


4 


1.000 


678 


4 


1.000 


676 


4 


75-79 


1.000 


1356 


6 


1.000 


1101 


. 5 


1.000 


1202 


5 


80-84 


.999 


346 


2 


.999 


398 


2 


.999 


421 


2 


85-89 


1.000 


422 


3 


1.000 


424 


3 


1.000 


425 


3 


90-94 


1.000 


372 


1 


1.000 


366 


1 


- 1.000 


378 


1 


All W/0 


1.000 


3811 


4 


1.000 


3629 


4 


1.000 


3739 


4 


70-79 . 


1.000 


852 


3 


1.000 


780 


3 


1.000 


809 


3 


80-89 


1.000 


378 


2 


1.000 


410 


2 


1.000 


423 




90-94 


1.000 


372 


1 


1.000 

"1 


366 


1 


1.000 


378 


1 



Note: A,s (cumulative errors by group, riot perc'ents), and £S between actual 
and predicted Js* for curves fit to data In Table 2. 
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Some data from Martin and Waag (1978). discussed in Section IV, 
illustrate the value of A for pinpointing possible skill integrations during 
training that may not be "readily apparent. Recall that two groups of subjects 
flew training sorties, 10 by each subject, in a simulator. One group 
experienced platfom nation and the other did not. The performance of each 
qrouD was rated on various tasks by instructor pilots (IPs) during five , of the 
trials The data points in Figure 1 (Section IV) represent mean ratings for 
each group on an overhead pattern. The points are connected with straight 
lines to provide a contrast with Figure 2, also in Section IV, where solid 
curves are shown representing the logistic equation. 



^ 1 + ge"'^'^ 



Bearing in mind that the IPs used a 12-point rating scale, and that the 
highest mean rating for either group was 6.56, what do the curves in Figure 2 
suoaest that is not apparent in Figure 1? In brief, it appears that the pat^ 
terns of data may well say more about the effects of motion than the -^ala 
WHts per se can reveal. The curve for the motion group is still rising on 
the fifth evaluated trial, while that for the no-motion group is not. Recall 
that in the previous example, A^s derived from error counts were good predic- 
tors of subjective checkride grades after more than 20 additional aircraft 
trials. A for the present motion group was 8.97, but only 6.36 for the no- 
motion qr-oup. The indications are that the motion group, due to continued 
integration of motion cues, could have improved well beyond the plateau 
reached by the no-motion group. (This conclusion is supported further by an 
analysis of 1*e inflection points in the curves. See later discussion.) 

ASYMPTOTIC LEVEL AND TRANSFER OF TRAINING. The relation of A to transfer of 
traininq is quite different from that of B and transfe-. B measures the 
extent to which Task 1 learning is immediately manifest in lask^ performance. 
Intuitively, one might say that B represents the portion of perrormance 
learned during Task 1 that is funclionelly congruent to Task 2 requirements 
without a need for adaptations to Task 2 conditions. On the other hand, A 
builds on B. but in doing so represents effects of Task 1 learning during Task 
2 that crnnot be manifest at the outset because it is not immediately 
congruent to Task -2, requirements. 

One example of delayed effects of Task 1 learning is their influence on suc- 
N cessive integrations of skill components during Task 2. Both cognitive and 
\peSptual-motor aspects of Task 1 learning are likely to be involved. Proce- 
dS?a?'^tasks, for example, become less and less rote ^"^f'^Ctppnn'. iS??) 
Donents are organized . 1 nto patterns and h1erarch1es--Greeno s (1977) 
"clprehension" criterion discussed in Section III Ta^k Perfonnance becom^ 
more stable as a result, and is more likely to be retained (Prophet, 1976, 
ScTendel. Shields. & Katz. 1978). Recognizi ng.,that such skills, depending on 
their complexity, may follow a sequential pattern of Plateaus as show" " ^er 
in Fiqure 5, A represents a dependent variable for both Task 1 and Task ^ 
earniC that Tan identify the point at which a given stage of integration s 
cOTDleted and the level of achievement at that stage. Given a particular 
^^e of achievement, how early in training .it is approximated can be readily 
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detennlned by noting the value at which ^ approximates a given percent of A. 
Or, given plateaus for two or more groups, A^ can indicate the level of, say, 
skill integration that has been achieved by each. 

Another value for A was pointed out by Woodworth and Schlosberg (1954, p. 
665-666). The difference between A end beginning level B is a basis for 
viewing what is or could be accomplfshed during training. Sy fitting a curve 
to the data (which they recommended) , answers can be obtai ned to questions 
such as. How much of the possible learning was achieved in the first X trials? 
At what point during practice was a given proportion of the possiblenearning 
achieved? Answers to these questions could be Important for defining optimal 
levels of Task 1 practice prior to attempting Task 2, especially for part-task 
devices; or if optimal leveis are already known, for identifying achievement 
levels short of "mastery" to be used in comparing training methods. 

RATE OF LEARNING 

Rate of learning R^ is widely recognized as an important measure of effi- 
ciency of trai ni ng . Deci si ons regardi ng the al 1 ocati on of time, personnel , 
and material resources to training depend heavily on how rapidly trainees 
learn. 

Because rate of learning has been a, if not the, primary criterion for 
decisions regarding training allocations and practices, most researchers in 
training studies attempt to measure it^ and existing measures are quite useful 
for a number of purposes. However, they are often crude, and they frequently 
confound £ wi th other variables, especially beginning level, in ways that pre- 
vent measures of £ from providing the infonmation they could. . Furthenmore, it 
is likely that uses of £. evaluations of training more often tf.an not are 
governed by the nature of JR measures conveniently available rather than by 
what would be desirable for the purposes of the evaluations. The fact that 
cost analysts bemoan the Inadequacy of measures of rates of learning is a case 
in point (£f • , Orlansky & String, 1977). 

Rate of learning is defined as the change in achievement per unit of 
change in the Independent variable. Stated symbolically, 

R = AY_ 
A X 

where the deltas indicate "change In" ^ or 2^. To explore the meaning of R^, 
however, and to relate it to learning processes, it Is necessary to examine 
A relation to the equations used to describe learning data. The 

tasTT is much simpler if A X is considered to approach zero as a limit, for 
then the di fferenti al cal cuTus can be used. Using the standard notation, 
dY/dX^ will be sub^stituted for A VA X^ as A X_-^ 0. 

The dependence of £ on the nature of the equation Involved can be seen 
readily by comparing two functions frequently used to describe learning data. 
(They are also two of the oldest.) One, the exponential growth equation (also 
temed the monomolecul ar equation in chemistry), is 
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Y = A(l - e-kX) 

where A and e have their usual meanings. If this equation, after suitable 
adjustments, Ts differentiated with respect to the result Is 

dY 

« k(A - Y) = R. 

dX 



This differential equation has a straightforward intuitive interpretation. jA 
is the asymptote, the maximum to be learned, so U • Y^) Is the amount not yet 
learned, and k_ is a proportionality constant.! Thus, the rate of learning 
R (=dY/dX) on, say, a particular trial is a constant proportion of what has 
TTot yFtHBeen, but can be, learned. 

The second illustrative equation was used earlier, viz.. 



Y = ^ 

1 + ge-kX 

For its differential form, the so-called autocatalytic monomolecular (AM) 
equation, 2 

^=lcY(A-Y), 



will be used because it permits direct comparison with the one Immediately 
preceding. 

While for the first equation, was, so to speak, a constant proportion 
of the learning yet to go, in the second equation R is the same except that 
the proportion is multiplied by the amount already learned. In other words, 
learning catalyzes Itself; it "snowballs.** The more the learning, the faster 
learning occurs. In view of vertical transfer processes that can occur during 
training, it is especially Important to be able to Identify their effects. 
More on this below. 



In most discussions of learning curves, is referred to as a measure of 
rate of learning, which it is provided As are the same, and the same equation 
is used for all groups. Otherwise, "\ is not linearly transfonnable to 
dy/dx = R^. 

^Apparently! it is not generally recognized that this equation is one 
form of the more general equation. Compare Lewis* (1960) statement that the 
AM equation has had no theoretical basis in psychology (p. 465), and Estes* 
(1963) criticism of its uses, with Estes* (1950) earlier employing it in the 
logistic form given above for theoretical purposes. If Jc in the logistic 
equation is transformed to k^' = k/^, the AM differential equation holds for 
the logistic equation. 
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An example us^ng data from Brictson and Burger (1976) will Illustrate the 
need for measuring R in a manner that it does not become confounded with B^. 
One group of subjects first practiced night carrier landing training in a 
trainer Device 2F103 (NCLT group). A second group practiced only in the A7E 
aircraft. The data points in Figure 6 represent mean ratings by a Landing 
Signal Officer of landing performance of each group on the first eight 
attempts in the A7E. 

The data are highly Irregular, due almost surely to variations in flight 
conditions and to instabilities in performance that characterize early 
learning of carrier landings (Isley et al . , 1982). Order is brought to the 
data, however, and clear patterns emerge when curves are fit to them as in 
Figure 7 . 

Each curve in Figure 7 represents three radically different equations, 
the eTponential growth function, the logistTc~f unction, and the Gompertz func- 
tion, a double exponential equation (see Lewis, 1960). The reason for using 
three equations, even though the fits are essentially identical, will become 
apparent. 

The first thing to notice is that the transfer (NCLT) group was superior 
overall, even though its B was clearly below that for the control group. The 
overall superiority was due to a rate of learning that overcame the original 
handicap before the 4th trial, and continued to a higher A 1 evel . The impli- 
cation is that the device training resulted in negative transfer as far as B 
was concerned, but at the same time laid a foundation for unusually rapi? 
progress once the transfer group transitioned to the aircraft. A training 
□roqram or device designer might well want answers to two questions: What is 
the source of the negative transfer as regards B? What were the charac- 
teristics of the device training that led to rapfi skill acquisition in the 
aircraft? 

There is not enough information available in the research report to 
answer either question, but two points are pertinent. First, had there not 
been a basis for differentiating R from B, the questions would not have even 
been asked. One might suspect Trom Figure 6 that two different types ot 
manifestations of transfer were evident, but the possibility did not demand 
attention until curves were fit to the data as in Figure 7. Now that the dif- 
ference is obvious, one can narrow down possibilities for program improvements 
to factors that led to a negative B effect. (See discussion this sec- 

tion of Beginning Level and Transfer of Training, and Intersensory Transfer in 
Section IV.) 

Childs, Lau, and Spears (1982) provided an excellent example of the 
complexity of transfer with respect to B^, A^, and R. Half of a group of pilots 
transitioning from a single-engine aircraft to a multi-engine aircraft had 
prior practice using a training device of very low fidelity. The other half 
of the group practiced only in the multi-engine aircraft. There was a 
substantial negative transfer effect on B that dissipated completely after the 
first aircraft day. In fact, the negative effects held only for maneuvers 
Drarticed on the first aircraft day. Maneuvers that were practiced in the 
aircraft for the first time after the first aircraft day showed no negative B^ 
effect at all. Furthermore, there was a positive transfer effect on ^ as 
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LANDING TRIAL 

FIGURE 6. MEAN RATINGS BY LANDING SIGNAL OFFICER FOR 
GROUPS WITH AND WITHOUT PRIOR NCLT TRAINING 
(DATA FROM BRICTSON & BURGER, 1976). 
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represented by performance on the final checkride following aircraft training. 
It was also evident that early aircraft practice on one maneuver In particular 
generalized to performance while learning other maneuvers (vertical transfer), 
resulting in a higher rate of learning Childs et aK explained that the 
low device fidelity forced cognitive learning during practice with It, thus 
enhancing A due to better cognitive organization. However, was depressed 
because th"e original cognitive representation of tasks was not adequate for 
immediate implementation in the aircraft. With practice, however, the 
perceptual-motor interface was quickly achieved, (Their data were not ade- 
quate to explain why early training on one particular maneuver had a substan- 
tial vertical transfer effect on R, though the effect appeared due to the 
precise discriminations needed for the maneuver. See discussion of structural 
characteristics of movements in Section IV, specifically Simon's [1956] 
finding that amount of transfer depends on the number and type of 
discriminations involved.) 

The second point concerns the analytic possibil i ties of R for the 
Brictson-Burger data. Recall the differential forms discussed earlTer, 



R = k(A - Y) 
for the exponential growth function, and 



R = kY(A - Y) 

for the autocatalytic function. The first equation implies that learning 
simply accumulates, while the second implies that learning not only accum- 
ulates, but utilizes previous learning (vertical transfer) to speed up the 
process. In other words, learning becomes a tool for subsequent learning. 
Therefore, the fact that these two equations fit the data equally well--so 
nearly equivalently that one curve represents both equat1ons--1 s of con- 
siderable significance to one concerned with the design of training programs. 
That is, with respect to the second alternative above, an equation that 
assumes learning only accumulates fits the data as well as one that assumes 
the accumulation is enhanced by successive levels of achievement. Therefore, 
whatever NCLT training contributed, it did not facilitate using successive 
stages of learning as a tool for subsequent progress. Had one or both 
patterns of data yielded a sigmoid (S-shaped) curve, implying a snowballing 
effect, only the autocatalytic equation could have fit the data. (Sigmoid 
effects are suggested by the data points, but apparently they are due to 
chance variations.) Had a sigmoid curve been obtained only for the NCLT 
group, for example, the inference would have been that NCLT training resulted 
in a "learning to learn" phenomenon while aircraft training did not. This kind 
of analytic distinction reveals what has been, as opposed to what might be, 
accomplished in Task 1 training. 

Another use for R is Illustrated by the predictive value of related k^s 
for the data from Prophet (1972) that were discussed earlier. Table 4 shows 
ks and their ranks for the various groups defined by final checkride grades, 
■^ata are given separately for fits of the equation using d^ys 1-3, 1-4, and 
1-5. Recall that the equation used was 
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Y = AX 

X + k 

so the smaller the k, the faster the progress toward A. 



TABLE 4. RATE CONSTANT k^ FOR CUMULATIVE ERRORS BY CHECKRIDE GRADE 
AND NUMBER OF DAYS USED TO FIl EQUATION 



Group 


1 


- 3 


Days used to fit equation 
1 - .4 


1'- 


5 




Rank 




KanK 


k^ 


Rank 


Precheckride W/0 


99.51 


7 


82.99 


7 


78.78 


7 


Check ride W/0 


20.14 


5 


22.16 


5 


25.94 


5 


70-74 


9.81 


4 


9.28 


4 


9.24 


4 


75-79 


31.26 


6 


25.17 


6 


27.59 


6 


80-84 


5.95 


1 


7.01 


1 


7.50 


2 


85-89 


7.59 


3 


7.65 


3 


7.66 


3 


90-94 


7.26 


2 


7.15 


2 


7.41 


1 


All W/0 


60.09 


4 


57.15 


4 


58.97 


4 


70-79 


15.72 


3 


14.28 


3 


14.85 


3 


80-89 


6.65 


1 


7.31 


2 


7.59 


2 


90-94 


7.26 


2 


7.15 


1 


7.41 


1 



Note: Equations were fit to data from Prophet (1972); compare with Tables 
2 and 3. 



The rank correlations between grade group and k are perfect for 4 and 5 
trial -days when the larger groupings are used. When broken down into seven 
groups^ the correlations are .79 for days 1-3 and 1-4, and .86 for days 1-5. 
That the predictive information frojr ks does not duplicate that from is evi- 
dent in the less than perfect correTations between ks in Table 4 and ^s in 
Table 2. (A and k must correlate highly with eacTi' other for these data, 
however, because eacTi correlates so highly with a third variable.) 

It was mentioned when the Prophet data were discussed under asymptotic 
level of learning that a regularity existed that could be observed only 
throuoh curve fitting or comparable techni-ques. This regularity is revealed 
in two different ways. In Table 5, percent errors for each group on the 28th 
day were projected from curves fit only for days 1-3, 1-4, and 1-5. Y values 
were cumulative percent errors, so the projections were made by entering = 
28, and )^ = 27, in each equation and taking the difference.! The general 
trend shows that the differences predicted from equations for three, four, and 



1 ' - ^ 

This approach was used ratfffer than a differential equation .for dY/dX 

because the change in X. of one d^y is not ipear enough to zero for A V^A. 

approximate dY/dX . ^ 
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five days increase slightly in stability as final checkride grades are higher, 
but that predictions vary very little for a given group regardless of the 
number of days used. This suggests that performance observed e^.rly in 
training can reveal what will eventually be accomplished. 



TABLE 5, 


PROJECTED PERCENT 


ERRORS ON DAY 


28 BY CHECKRIDE GRADE 






AND NUMBFk 


OF DAYS USED TO FIT EQUATION 












Days used to 


fit equation 








1 


3 


1 


- 4 


1 - 5 






Percent 




Percent 


Percent 




Group 


errors 


Rank errors 


Rank 


errors 


Rank 


rrecnecKrioe w/u 


39 


7 


36 


7 


35 


/ 


Checkride W/0 


i 1 


5 


12 


6 


15 


6 


70-74 


5 


4 


4 


4 


4 


4 


75-79 


13 


6 


10 


5 


10 


5 


80-84 


1 


1 

X 


2 


2 


2 


1.5 


85-89 


3 


3 


2 


2 


3 


3 


90-94 


2 


2 


2 


2 


2 


1.5 


All W/0 


30 


4 


29 


4 


30 


4 


70-79 


7 


3 


7 


3 


7 


3 


80-89 


3 


2 


2 


1.5 


2 


1.5 


90-94 


2 


1 


2 


1.5 


2 


1.5 


Note: Equations 


were fit to 


data 


from Prophet (1972); compare 


with Tables 2 


3, and 4. 














A question 


remains, however. 


The values 


shown in Table 


5 are indepen- 



dent of levels of error occurrences. That is, differences between performance 
on days 27 and 28, predi :ted from three, four, or five days of observations, 
are quite small, but what about the stability of predictions on day 28 alone? 
The answer is obtained by measuring the variabilities of cumulative errors 
predicted from equations for three, four, . and five days. For the 90-94 
checkride grade group, the standard deviation was 2.86, while the standard 
deviations were 11.3 for the 80-89 group, 11.9 for 70-79, and 7.4 for all 
washouts. The 90-94 group is significantly less variable than the other three 
whose standaird deviations do not differ significantly. (But note .that all 
standard deviations are very small compared to the magnitude of cumulative 
errors for Day 28.) It is apparent that, for the groups whose checkride 
grades fell within the 90-94 range, a curve using only data from the f^r^t 
three days Is essentially the same curve as one using five days , but that the 
curves diverge slightly fo-^ lower checkride grades. 

0 

Variability In perfoniance has been recognized previously as an Important 
Indicator of level of skill Integration, and it was demonstrated to apply in 
one study of simulator training for carrier landings (Isley and Spears, 1982; 
Isley et al ., 1982). 
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RATE OF LEARNING AND TRANSFER OF TRAINING. The discussion of th.i? data from 
Brictson and Burger (1976) revealed an Important relation betsVeen R and 
transfer. In that case, Task 1 experience, although resulting 1n! some"7iega- 
tive transfer at the outset, provided an Impetus for Task 2 learnirjg that more 
than overcame the original deficit. Being able to measu such anilmpetus, or 
the lack of it, is necessary for analytic evaluations trainlncj programs-- 
what trainees achie/ed, how they achi8ved--as well as research on transfer of 
training. 

A broader picture of the value of R^ c,an be obtained by an understanding of the 
mechanisms of transfer. A few brief comments will Illustrate the value of the 
analyses In Sections III and IV. 

First, any behavior can be viewed as a complex of components, seme of which 
are facilitating, some interfering or disruptive, and some neither. In skills 
requiring psychomotor coordinations, it is important to guide tho learner at 
the outset to practice facllitative components and avoid those nhat produce 
disruptive interference. Training devices offer excellent opporiuni ties for 
training in thi$ manner. Guidance and feedback can be specific to actions, 
and tasks or parts of tasks can be learned in hierarchical sequences that 
maximize rate of progress (Caro et al., 1981). In other words, training 
programs can be designed to optimize learnina and instructloncti processes 
rather than to conform to the exigencies , of operational equipment. Rate of 
progress during Task 1 learning thus Is a' criterion for training efficiency, 
and during Task 2 learning, for^^conf inning training effectiveness. 

There ^-is another aspect of ti^ansfer which has not been studied formally as a 
transfer phenomenon per se to any great extent in fr ^ry in^ 
demonstrated in Section III, 1t should be, and R t leti" 1g e 

be the primary variables of Interest. SpecificTll^ , aVi ^uil 
support motoijU^skil Is necessarily depends on transfer. With . w otab. 
exceptions, dB|n1tive training in military programs has not been evaluated 
within a transfer paradigm. Pencil and paper tests are used instead. Yet, 
one of the earliest studies of transfer by Judd published in 1908 (cited by 
Woodworth & Schlosberg, 1954) showed how purely "academic" training can 
transfer to performance of a motor skill. The study is worth reviewing 
because It has clear Implications for using _R during Task 2 *;o evaluate cogni- 
tive training. (Judd's study was repeated by Hendrlckson and. Schroeder [1941] 
with similar results.) One group of fifth- and sixth-grade boys were taught 
pri ncl pi es of 1 igh t ref rac tlon - (Task 1 ) . They and a comparable- control- group 
then practiced hi.tting a target submerged twelve Inches under water (Task 2). 
The groups performed equally well. Next, the target was raised so that It was 
only, four Inches under water, and the subjects tried again. > The transfer 
group was clearly superior the second time. Knowing about refraction did not 
help until the knowledge had beerr Interfaced with an action. Transfer of the 
conceptual knowledge, once Interfaced with psychomotor skills acquired in the 
first Task 2 effort, was evident. 

Hundreds of learning studies could be cited to support the point: Cognitive 
training can provide a framework -for adapting jnotor actions to the require- 
ments of the situation, but the framework cannot be assessed until after the 
motor elements are acquired and related to the framework. Thus, B^ cannot 
measure many contributions of cognitive training to skill perfo^nnance. It is 
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restricted to those components which do not require the learning of an inter- 
face, can measure such contributions directly. If the use of cognitive 
training during skill performance, as indicated by R^, is evaluated according 
to the nature of the cognitive training, manner of instruction, etc,, signifi- 
cant improvements can be possible in cognitive instruction. (Also, because 
comprehension provides a broad scope of possible uses of skills, as well as a 
basis for sel f ~gu idance and self-correction in skill performance, good cogni- 
tive foundations can be expected to result in high asymptotic levels of 
performance. ) 

The exceptions alluded to earlier regarding the use of transfer paradigms in 
applied training studies to evaluate cognitive training typically involved 
what is termed either "cognitive pretraining" or "dynamic observation." Both' 
types of studies have merit, but as implied in Section III, tney have hardly 
scratched the surface compared to what could be done. (A cognitive 
pretraining study is examined in the next subsection.) 

The versatility of for research on transfer is illustrated by its value for 
deducing mathematically measures of transfer cotiimonly in use. ThP. various 
ratios for estimating percent of transfer (Gagne, Foster, & Crowley, 1948; 
Murdock, 1957; Ellis, 1955) and transfer efficiency (Povenmire & Roscoe, 1971; 
Roscoe, 1971 , 1972) all incorporate a rate concept. The advantage of is 
that, being derived from aljl^ data, it provic^^s reliability not possible for 
measures based on only pairs of observations. Furthenmore, if Task 2 B_ 
levels, A levels, or Rs obtained! for different amounts of Task 1 practice (as 
In' Rosco"e's incremental transfer paradigm) are fit to equations, R^s derived 
for the incremental functions can measure rate of change of Bs, As, and even 
Rs as a function of amount of Task 1 practice. Incremental fransTer can thus 
Fe analyzed into separate types of components, with a reliable measure of the 
rate of change. 

INFLECTION POINT 

The inflection point P of a learning curve is that point at whichj a posi- 
tive acceleration changes To negative, or vice versa. In a sigmoid (S-shaped) 
curve, for example, it is the point at which the rate of learning stops 
increasing and starts slowing down, even though progress continues on the 
whole. Mathematically, it is the X, value for which the second differential of 
the equation for the curve equals zero. 

P apparently has not been used as a parameter for studying learning and 
transTer. Frorfi\a logical standpoint, it could be a val uable, measure. The 
sudden bursts of progress that occur when skill integration occurs, when skill 
elements "fall into placo*," or when cognitive understandi ng. becomes Interfaced 
>^ith. skill performance, will produce a curve like that In the first part of 
Figure 8 where rate of progress Is Increasing. As shown, the Inflection 
occurs at X = 8.79, for beyond this point rate of progress becomes slower and 
slower. 



^Rs can be unreliable when As or B_s are not known a priori, but there is 
a straTegy for getting around the problem. See Estes (1950). 
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As shown in the figure, can be measured in units of either X or Y. The 
formal definition of P just given is in units of £, i.e., J^. The level of 
achievemeht corresponcTi ng to a given can be determined by entering Pv into 
the equation for the curve and solving for Y. This latter value will be 
referred to as P^y. 

A study discussed earlier illustrators how K and Py can aid in inter- 
preting learning and transfer data. Recail in Section TV that the data from 
Martin and Waag (1978)' appeared at first to favor a no-simulator-motion group 
(see Figure 1 In Section IV). However, curves fit to these data as shown in 
Figure 2, also in Section IV, projected an A_ for the motion group substan- 
tially higher than the A projected for the no-motion group. P^s for these 
curves- support the validity of these projections. For the no-motion group, 
Py = 0.90 end P^= 3.18; for motion, Py^ = 2.78 and Py = 4.48. It is evident 
Tnat the period of positive acceleration was briefertor the no-motion group, 
and that rate of progress b^gan to decelerate at a lower achievement level. 
Considering that acceleration and deceleration patterns can reflect underlying 
integrations of skill components, it is reasonable to conclude (tentatively) 
that (1) motion cues in addition to those shared with the no-motion group 
comprised a larger set of stimu'li to be integrated; (2) that the integration 
required mbre practice; (3) that when integrated;- the more complex set cf 
stimuli permitted a higher level of performance; and (4) building on the 
greater amount of information in the more complex cue patterns, skill achieve- 
ment can be expected to continue to a higher _A level than would be the case 
for the- less complex (no motion) set of cues. 

Some data from Smith et al.v(1975) illustrate a different pattern of P_s, 
one in which only Pj^ differed. As explained earlier, they gave one group of 
student pilots intensive cognitive pretraining to aid in recognizing flight 
segments and landmarks, while a control group had only "normal" instruction. 
Recognition of 1 andmarks during later aircraft r^ides showed a ^pattern of pla- 
teaus as discussed earner under asymptotic levels of learning. The pattern 
of recognition of fl ight segments revealed an instance where IP can provide 
useful information. Figure 3 i n Section IV shows logistic curves fit to the 
mean number of flight segments recognized 'for each o^ the first 14 rides, and 
Table 6 gives the ^s, ^s, k^s, and Ps for each of the two groups of data. The 
fits of the equations are quite goo"d as indicated by the j^s in the table. 

TABLE 6. CONSTANTS FOR CURVES FOR c# 
NUMBERS OF LANDMARKS RECOGNIZED 



Group 


r 


A 


B 


k 






Pretrained 


.998 


4.17 


1.49 


.311 


1.88 


2.09, 


Normally trained 


.999 


4.09 - 


.88 


.347 


3.73 '^^ 


■ 2.04 



Note: Data froni Smith et al. (1975). 
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The Pv show that the control group probably did not have the full advan- 
tage of autocatalytic learning, of building learning on learning (see earlier 
discussion of R^), until just before the fourth aircraft trial, while the 
pretrained group reached this point just prior to the second aircraft trial. 

The P^s alone might indicate that the pretraining group "topped out" too. 
soon; but in view of their superior £ levels,- and the fact that Pvs are essen- 
tially the same for bot\\ groups, it appears that the cognitive framework for 
recognizing flight segments did not affect what would be integrated as in the 
preceding example, but tt did permit a degree of integration of pertinent cues 
during Task 1 and/or very early in Task 2 that the control group did not 
achieve until later. Note how quantifying several parameters facilitates 
interpretation of each one in tenns of what occurs during training. 

INFLECTION POINT AND TRANSFER OF TRAINING. T^e examples just discussed reveal 
an important relation between _P and transfer. By pinpointing wheh learning 
curves change from positive to negative acceleration, it can indicate the 
point during practice where certain integrative processes are completed. 
Stated in units of Y (achievement level), P can be related to the proficiency 
level of transferred" ski 1 Is. Such indicatilons can be of value when the Task 1 
learning at issue is of a cognitive nature. However, as illustrated in the 
analyses of Martin and Waag's data, the value of P^ is not likely to be limited 
to purely cognitive Task 1 learning. Many motor skills Involve noncognitive 
integrations, and develop in a sigmoid manner regardless of cognitive 
components. P might just as well indicate, say, when a pattern ot part- task 
practice resuTts in a superior integration of skill components early' in, or 
prio.' to, Task 2 practice. 
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SECTION VI 



VALUE OF ANALYSES FOR TRAINING'^^AND TRAINING RESEARCH 

• This section summarizes the varre of the foregoing analyses for the 
deslqn of training programs and' related equipment. It also suggests three 
research topics, arising from the analyses, that would help the value to be 
realized. 

ASSESSMENT OF SKILL ANALYSES FOR TRAINING . . 

Sections III and IV reveal an optimism regarding the potential value of 
modern conceptions of coqnitive and motor sMlls for guiding training^ design. 
While these conceptions are often criticized for slighting Instruction as 
they ha\te been on occasion in this report, the fact remains that there ls a 
difference between a theory of learning (or performance) and a technology of 
Instruction. By far, most of the investigators whose work and Ideas have been 
cited in this report were concerned with theories of performance, but with the 
implication that the theories set forth the foundations of learning. That is 
they specified the nature of what is to be learned. At the same time the r 
methodologies, in isolating individual processes, for example, resulted in 
extensive analyses of roles of processes and conditions that can facilitate or 
interfere with perfomiance and learning. This last statement is true even of 
research in motor performance, an area where learning has been especially 
ignored in recent work. 

The development of a training technology, to a great extent. Involves 
nothing more than insightful extensions to instruction of what Is known and is 
cont nLll/being clarified regarding the nature of skills. Suggest ons as to 
r.at is involved appeared often in preceding sections-an operational language 
for manipulating variables (Section II). equating processes of skill acquisi- 
tion to those of problem solving (Section III); the integration of tasks 
cinprising skills (Section IV); etc. Thus, the richness of modern conceptions 
of skill performance has much to offer. 

At the same time, the concerns of a few cognitive theorists for an 
instructional technology, dating to the 1960s, are now s^PPl«"ented by a 
growing emphasis on instruction. (Concept fomation has, of course, beer, of 
VnlVrelt for decades.) Bruner (1966) was a relatively early major figure as 
was Gagne (1962. 1965,"l968) whose impact on military training is evident in 
ISO Glaser's emphasis on instruction, ranging from programmed learning to 
loSern 'cognitive t^heory. has also been evident since the early 1960s aser. 
1962 1965) and continues to the present (Glaser. 1976. 1982). But increas- 
ingly there have been reports of analyses and experiments by a number f 
t&ts that bear on the adaptation of 'Of'^'^'.'^'^'y.l^J'^^^^^ 
compare, for example, the nature and scope of articles in Cogn ^ f.^^*^^^^^ 
and Their Acquisition (Anderson. 1981) and the reviews by Resnick ana 
Wittrock an'ij Lumsdaine ( 1977). 

This concern with instruction apparently is not characteristic of 
investigators of mtor skills (Newell. 1981). Part of the ^J^k Js alm^^^ 
sS^ely due to the lag. relative to cognitive skills, of theoretical 
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development of the processes involved 1n motor performance, and to the fact 
that academic researchers of motor processes--except for a few in departments 
of physical education-^do not have a training context for their research. 
Even so, as explained in Section IV, some conceptions of motor skills (e.g., 
closed-loop or cybernetic theory, Adams, 1971; Smith & Smith, 1966) lead 
naturally to a training technology. Furthermore, as one ponders the logically 
necessary roles of schemata in motor performance, it is evident that what 
holds for the training of cognitive schemata applies in some fashion to 
teaching motor skills. 

The conclusion is that a training technology, derived from present 
knowledge, can be available. Although far from complete, the technology that 
could be derived promises much beyond the oversimplified, yet significant 
pioneering work of a Thorndike. The question is how to proceed in the devel- 
opment of the training technology. The , next subsection addresses this 
question through illustrative examples of research and development efforts 
that are sorely 'needed. Deliberately omitted as an example is an extrapola- 
tion of earlier analyses of skills to the design and use of part-task and low- 
fidelity training devices. This is a logical enterprise that should be 
pursued in a subsequent study. The research suggested below would add 
empirical substance to the logic, 

ILLUSTRATIVE RESEARCH PROJECTS 

There is no way to conceive of the number of research projects that could 
develop from syste^natic applications of modern theories of skills to problems 
in skill training- Every processing unit, cognitive or motor, can be a candi- 
date for applied research on any rkill, component task, and mode of training. 
Research of this nature will eventually be required. However, the duplication 
of effort from skill to skill can be drastically reduced by adopting a strat- 
egy that answers as many fundamental questions as possible on a general, and 
general izable, basis. For example, the nature of stimulus and response simi- 
larity as related to device fidelity requires a cognitive analysis for ade- 
quate understanding of what is involved. For each skill, one could go through 
the mapping procedure suggested in Section II, incorporating the processes 
detailed In Section III. But there is a logically prior question that, when 
answered, could render comprehensive skill-by-skill, device-by-device, anal- 
yses of cognitive similarity completely unnecessary. What is the nature of 
the cognitive representation of the skill, of its analogical correspondence to 
situations for its perfonmance? It is desirable to know the analogical 
correspondence in any case, so cognitive similarity, being one aspect of 
correspondence, would be analyzed only to the extent necessary to understand 
correspondence. 

The strategy would not be to develop a comprehensive methodology for ana- 
lyzing cognitive similarity, for such a methodology would probably go into 
issues of no particular importance. On the other hand, a methodology for 
detenmining correspondence would encompass any procedures for analyzing cogni- 
tive similarity that might be needed, and in the process define useful goals 
for those procedures, thereby limiting them to what is needed for training. 
In a broad sense, this strategy is implicit In the illustrative research 
topics discussed below. The topics concern (1) procedures for learning 
analyses, (2) examination of the nature and process of skill integration; and 
(3) providing for interpretable manifestations of transfer. 
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PROCEDURES FOR LEARNING ANALYSES. It was stated in Section I that learning 
analyses are needed to guide the design of training programs and related 
equipment. Discussions in Sections II-IV reveal jur.t how far learning anal- 
yses should go beyond ordinary task analyses, and employment of ISD proce- 
dures, for deriving training regimeiis. Task analyses are needed to identify 
elements of correct skill performance. However, in and of themselves, they do 
not lead systematically to a training regimen because they make no allowance 
for the development of the host of separate executive, short-term, and long- 
term processes that are the essence of skill learning and performance. 
Furthermore, ISD procedures recognize these processes only intuitively in that 
ISD focuses primarily on training inputs and response outputs, ignoring what 
happens in the processing of inputs to produce outputs. 

The research suggested here would develop a prototypical methodology for 
comprehensive learning analyses that would guide the training analyst in 
applying what we know about discrimination and generalization learning to the 
processes invol ed in skill learning and performance. There would be three 
main facets to learning analyses. First, task analyses would identify skill 
components and conditions and criteria for performance. Procedures for task 
analyses are, of course, already well developed. Nevertheless, a precaution 
often cited should be observed: What one gets from a task analysis depends, 
whether consciously or unconsciously, on the purpose the analyst has in mind 
at the time. To be useful in learning analysis, the task analysis should 
clearly pursue the goal of identifying task elements, performance conditions, 
etc that can have representation in the cognitive-motor processing that 
underlies skill performance. For example, task analyses do not ordinarily 
designate completion of certain subtasks as subgoals to be achieved. One can- 
not exploit what is known regarding the roles of subgoals in the cognitive 
organization of skills unless they are recognized as subgoals, including their 
interrelations with other tasks in the overall comprehension of skills. 

A second facet of learning analyses is what was termed cognitive analyses in 
Section III. A cognitive analysis would focus on all the executive and long- 
temi processes discussed in that section, together with short-term processes 
that comprise the training interface. Especially important would be the 
cognitive differences between experts and novices in a given skill, for the 
differences would identify what must be learned. Similarly, when applicable, 
there should be a comparable analysis of purely motor processes \as detailed in 
Section IV. (One may or may not wish to call these latter processes 
"cognitive." It does not matter what they are called, however, so long as 
they are recognized a-, essential elements in information processing.) Again, 
task analyses as ordinarily conceived can often be inadequate, even as task 
analyses. For example, when skill elements must have harmonic interrelations, 
it is not sufficient to identify only the cues, responses, and performance 
criteria' for task elements. At least the broad nature of the coordinations 
required should be specified so as to guide the analyst in identifying 
patterns of harmonic consonance during information processing. 

The third aspect of learning analyses is applying principles of learning and 
behavior to the development of the cognitive-motor processing of information. 
With the knowledge derived from coqnitive task analyses, the targets for 
training would thus become the entire matrix of mfomiation processing, not 
just output variables. 
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Because the intent is to establish a prototypical methodology for learning 
analyses, at least two type? of skills should be considered, one dealing pri- 
marily with procedures and one requiring problem solving as in trouble- 
shooting. If feasible, a third type of skill that involves coordinated motor 
performance should also be included. For each skill, the three aspects of 
learning analysis just discussed would be pursued, more or less in order. 

The approach to the cognitive-motor analyses needs special comment. At the 
outset, the organizational structures of the cognitive-motor systems charac- 
teristic of experts in the skills should be determined. Several kinds of 
information are of interest, depending on the skill: (1) patterns of cogni- 
tive representations of tasks comprising a skill, including higher order 
equivalence of hierarchical structures that vary in details from one expert to 
another; (2) rel ations among task requirements, perceived goal s, and the 
cognitive representations; (3) relations of cognitive representations to 
characteristics of various situations for performing the skills; (4) similar' 
relations with other skills that accompany or must otherwise be coordinated 
with the skill at issue; (5) patterns of encoding (attentional factors in per- 
ception, rehearsal strategies, etc-) of situational inputs and monitoring of 
actions; (6) subgoals and checkpo'nts that .are established and the contin- 
gencies for actions related to each; (7) the backlog of infonmation in long- 
term m€mory--its content, organization, and "rules" for actions; (8) patterns 
of task integration, focusing on timing and intra- and intertask coordina- 
tions; (9) variations in timing and coordinations together with factors that 
lead to them. (The list is not exhaustive.) 

Considerable idiosyncratic organization of these structures can be expected, 
even in experts- However, this need not be as formidable a difficulty as it 
may seeni- For example, it was explained in Section lY that speed-accuracy and 
facilitation trade-offs are subject to habitual processing patterns that vary 
with individuals- Thus, harmonic patterns in motor performance can also be 
expected to be idiosyncratic, as was observed by Westral for pilots practicing 
simulated aircraft carrier landings- Further, as discussed in Section IV, 
Isley and Spears (1982) and Isley et al - (1982) found that patterns of attend- 
ing subtasks during simulated landings varied from pilot to pilot, and for a 
single pilot from one trial or trial segment to another. Although the data 
are not as clear-cut, there is also evidence that the same thing happens 
during field carrier landing practice (Isley et al-, 1982) in which pilots fly 
the carrier landing approach and touch down as if they were landing on a 
carrier- 

But regardless of idiosyncratic patterns in harmonics and attention, the fact 
remains that there should be commonality in patterns of integrated perfor- 
mance- Recall from Section IV the need to establish an overai 1 harmonic pat- 
tern to which separate movement harmonics are consonant- It fol lows that 
while experts may differ in harmonic timing per se, their performance should 
reveal simil ar patterns of task elements that are in harmonic consonance - 
These patterns would identify task components for which consonance is to be 
developed. Surh information can go a long way toward defining device 
characteristics- Dynamic fidelity, for example, is needed in a device to the 



Westra, D. Personal communication, November, 1981. 
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extent harmonic patterns of separate movements are to be integrated in a 
manner that will not produce interference when the trainee practices with 
actual equipment. This is not to say that the timing of movements mus^ be the 
same for the device and actual equipment. Because compression of actions, 
i.e., perfonming a task in a shorter time period (see Section IV) is appar- 
ently no problem, the requirement is that devices foster the same r elative 
timing in the two situations. 

The next step is to complete similar cognitive-motor analyses for novices in 
the skills. Where do trainees start with respect to each of the kinds of 
capabilities of experts? For many skills, novices may have almost none of the 
capabilities except long-term habits and understandings of a generalized 
nature. Even so, it would be well to analyze further the expert's long-term 
knowledge (item 7 above) to determine what it has in comiron with that of 
novices. Thereby, one can identify what novices begin with that can be built 
upon, what needs expansion, etc. For rome kinds of long-term knowledge, it 
will be evident that cognitive pretraining is desirable (in the broad sense, 
not just what currently goes by this name in applied training). For other 
kinds, it will be apparent that concurrent or p>M'or perceptual and motor prac- 
tice are desirable to provide experiential meaning for cue-respons^e discrimi- 
nations and concepts. The nature of and critt-ria for prior and concurrent 
perceptual-motor practice should also be fairly clear. 

Next, well established principles of discriminative learning should guide the 
design of practice so that novices' skill structures, such as they are, 
progress to the cognitive-motor organizations characteristic of experts. As 
discussed in Section II and illustrated throughout Sections III-IV, the 
discriminative learning should target generalized discriminative systems 
(schemata), so varied practice should be introduced accordingly. Feedback 
during training should vary in kind and occasion, sometimes process by pro- 
cess, so as to (1) maximize discriminations; (2) minimize disruptive 
interference; and (3) promote eventual skill stabilization and integration. 

Quite a bit of introspective data will be necessary during cognitive task 
analyses. It is quite easy to go astray in gathering and interpreting such 
data (cf. Nisbett and Wilson's [1977] criticism of verbal reports and Ericsson 
anU Simon's [1980] attempt to clarify the issues involved). Introspective 
analyses have clearly been fruitful nevertheless (see references In Section 
HI to cognitive task analyses under Manipulation of Encoding for Training). 
The point is that these analyses must be done right if they are to provide 
guidance for training. 

As for other methodologies, ISD provides a suitable framework for viewing task 
structures vis-a-vis training, provided ISD is used as a general guide for 
relating cognitive-motor structures to training Issues. ISD shoul d not be 
substituted for an understanding of these structures, nor its prescriptions 
for a discerning application of wiiat is known regarding discrimination 
1 earni ng . 

The research suggested here would develop prototypes of learning analyses that 
i ncorporate these various methodologies so as to optimize the design of 
training programs and equipment. In the process, the skills ^Involved would, 
of course, be understood sufficiently for Immediate implementation of 
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training, or for the design of training equipment to use in teaching the 
skills. ' 

NATURE AND PROGRESS OF SKILL INTEGRATION. A key part of the analysis of skill 
learning is knowledge of the intra- and intertask integrations that occur how 
they occu- and when they occur. There has been almost no research on this 
Spic e ther in the laboratory or in applied contexts. In ^act th^^/^, 
cited above and in Section IV on integration of earner landing tasks (Isley & 
Spears, 1982; Isley et al., 1982) has few if any precedents. 

Because of the central role of skill integration in performance, there is a 
need to determine how it develops and factors that affect acquisition. 
inch i<: the research suqqested here. The effort could be combined with the 
de elopUt' of procedures for learning analyses, and eventually should be 
because the learning analyses will define clearly not f ,^1^;,^*°,,.^^ 

intearated but the nature of their organization. However, it wil take time 
; c'cJnplete thr^ analyses and implenent them i " Muc 

groundwork could be laid ahead of time through expansions of the analyse, of 
skill integrations as done by Isley and Spears arid Isley et al . 

Because so little is known regarding how skills are integrated, original 
research efforts should probably focus on the topological properties of skill 
organizations' and how topological relations develop with practice. Topo- 
lOQical properties refer to those characteristics of infonnation processing 
lhal are ccLon t^ a variety of separate skills. For example, the pilots 
studied by Tsley et al . appeared to have set subgoals in that one component 
such as anqle of attack (AOA) of the carrier approach was first brought into 
tolerance. Then attention shifted to a second .ubgoal . say. altitude 
to erance- etc. It is likely that the integration of a large number of skills 
fo lows such a pattern of alternating subgoals. Further, topological analyses 
wou d likely repeal the establishment of consonance in movement hamonics 
deSelopment'V hierarchical schematic processing (e.g.. which is easier, to 
fse ItUude control on a maintained AOA or vice versa , rehearsa 
strategies for remembering cue matrices and selecting and initiating 
responses, etc. 

AS stated in the discussion of the P'"«oeding topic considerable idi^^^^^^^^ 
can be expected from one performer to another in the details of integrative 
natterns. Yet topological properties should be common across perfonners. and 
Itln ZrnJ at least broad classes of skills. Hence, as with the preceding 
t^D c aT east two^%referably three, types of skills shoul d be represented 
]Tthe study so as to pemit common properties to be identified. Depending on 
Ihe skill t,e nature and progress of integration would be sought in the 
Cognitive representations of the component tasks as discussed in Section III, 
.hort-tem cue processing and experiential (memory) bases for cue interpreta- 
tion^ a^/o^the coordination of motor actions. Analytic methods would range 

°o:'in"rMve"an^^^^ by the performers and logical 
coanitive processes inferred from observed perfomance to empirical analyses 
nJ^JhVt thP oerformer is doing from time to time. However, provisions for 
empir^c\l''a'a rses should be mo're systematic than was the case with Is ey an 
'Js colleagues^ Their ^In^J^^s were somew a^^^^^^ /gaVns" which' 

Tucce s?;f ^s cts' r^^r^f ^r^^anc: ortLkl'c^pri sing skifls. thereby 
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making possible more adequate time series analyses. For this reason, early 
work should probably focus on skill learning using training devices that per- 
mit computerized records of performance on each task and subtask along a time 
dimension. 

INTERPRETABLE MANIFESTATIONS OF TRANSFER. Transfer of skill learning from 
training devices to operational equipment is a critical concern in any device 
training. It becomes problematic to the extent that the training equipment 
differs in scope (part-task devices) or is low in fidelity with respect to 
actual equipment. For this reason, there have been numerous studies of 
transfer of tasks learned in devices with a variety of characteristics to per- 
formance with operational equipment. However, as worthy as these studies have 
been, almost al 1 fal 1 short in one respect: They focus only on input 
variables (device characteristics, amount of practice, etc.) and output 
variables (performance with actual equipment). It sjjould be evident from 
Sections II-IV that one cannot understand the roles of inputs without allowing 
for how the informat O'i they provide is processed. In brief, there is a need 
for an empirical methodology that permits assessments of effects of infor- 
mation processing, ami hence of training practices and device characteri stic^ 
thai govern desirable processing. 

The question is how to design evaluative transfer studies so as to yield data 
with unambiguous implications for assessments of information processing. For 
example. Section V illustrates the kinds of inferences that coul d be made from 
parameters of performance curves. As was evident^ however, unambiguous 
interpretations call for experimental controls, and/or manipulations of 
variables during training, that are not now considered in the design of 
transfer studies. 

Building on the examples in Section V, and on the quantitative empirical tech- 
niques for isolating signal (cue) detection, speed-accuracy trade-offs, etc., 
as discussed in Section IV, a general methodology can be readily developed for 
isolating effects of most processing factors in transfer. The methodologies 
would incorporate four kinds of considerations: (1) training variables to be 
manipulated and general rules for the manipulations; (2) variables to be 
controlled experimentally ( or stati stical ly) , and/or varied in such a way that 
their interactions with training variables clarify ttfe effects of the latter; 
(3) measures of pre- and post-transfer performance that could reveal interpre- 
table effects of training variables; and (4) formulations through equations or 
otherwise of the measures such as to reveal particular dependencies of 
performance variables on training variables. 

Because of the availability of a variety of data concerning information pro- 
cessing, this research problem would be primarily a logical enterprise. The 
first step would be to 'Jetermina how processes discussed in Sections III and 
IV would dffect transfer, positive or negative. Second, empirical indicators 
of transfer effects would be identified. Third, more than one process are 
likely to affect some indicators, so factors would be identified such that 
their control or systematic manipulation would permit unambiguous assessments 
of separate effects of varir.bles at issue. Fourth, techniques for quantifying 
and comparing indicators of transfer would be developed (e.g., equations for 
learning curves, for likelihood ratios, hierarchical scaling, etc.). And 
fifth, convenient computational and interpretative schemes would be outlined. 
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INTEGRATION OF RESEARCH. These example topics not only illustrate the variety 
of worthy research that can be done, they also suggest how topics can be 
selected for programmatic efforts. A methodology for learning analyses would 
lead to the design of training programs and equipment; analyses of skill 
integrative processes would provide criteria for assessing the progression of 
learning and level of achievement at various stages; a methodology for iden- 
tifying the roles of processing variables in transfer would reveal specific 
strengths and weaknesses of the training equipment and the manner of its use. 
While many other research topics could, and eventually should, be proposed, 
these three focus on the major phases of any training. They would integrate 
the design, monitoring, and evaluation of training into a systematic 
conceptual framework. 
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